Sep 17 18:02:28 devstack cinder-volume[76006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 17 18:02:28 devstack cinder-volume[76006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 17 18:02:28 devstack cinder-volume[76006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 17 18:02:29 devstack cinder-volume[76006]: INFO dbcounter [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Registered counter for database cinder Sep 17 18:02:29 devstack cinder-volume[76006]: DEBUG oslo_db.sqlalchemy.engines [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76006) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 18:02:30 devstack cinder-volume[76006]: DEBUG dbcounter [-] [76006] Writer thread running {{(pid=76006) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 17 18:02:30 devstack cinder-volume[76006]: INFO cinder.rpc [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 18:02:30 devstack cinder-volume[76006]: INFO cinder.rpc [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 18:02:30 devstack cinder-volume[76006]: DEBUG oslo_db.sqlalchemy.engines [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76006) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 18:02:30 devstack cinder-volume[76006]: INFO cinder.volume.manager [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Determined volume DB was empty at startup. Sep 17 18:02:30 devstack cinder-volume[76006]: DEBUG cinder.volume.manager [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76006) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 17 18:02:30 devstack cinder-volume[76006]: INFO cinder.volume.manager [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 18:02:30 devstack cinder-volume[76006]: WARNING stevedore.named [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 18:02:30 devstack cinder-volume[76006]: WARNING castellan.key_manager [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 18:02:30 devstack cinder-volume[76006]: WARNING cinder.keymgr.conf_key_mgr [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 18:02:30 devstack cinder-volume[76006]: DEBUG cinder.volume.drivers.lvm [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76006) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 17 18:02:30 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:31 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] CMD "cinder-rtstool verify" returned: 0 in 1.098s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:31 devstack cinder-volume[76006]: DEBUG oslo_db.sqlalchemy.engines [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76006) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 18:02:31 devstack cinder-volume[76006]: INFO cinder.rpc [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 17 18:02:31 devstack cinder-volume[76006]: INFO cinder.rpc [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 17 18:02:31 devstack cinder-volume[76006]: WARNING stevedore.named [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 18:02:31 devstack cinder-volume[76006]: WARNING castellan.key_manager [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 18:02:31 devstack cinder-volume[76006]: INFO cinder.volume.manager [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 17 18:02:31 devstack cinder-volume[76006]: DEBUG oslo_db.sqlalchemy.engines [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76006) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 18:02:32 devstack cinder-volume[76006]: INFO oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Starting 1 workers Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Started child 76139 {{(pid=76006) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Full set of CONF: {{(pid=76006) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] ******************************************************************************** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Configuration options gathered from: {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] ================================================================================ {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] allow_availability_zone_fallback = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] allow_compression_on_image_upload = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] allowed_direct_url_schemes = [] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] api_rate_limit = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] auth_strategy = keystone {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] az_cache_duration = 3600 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_availability_zone = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_host = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_name = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_stats_polling_interval = 60 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backup_api_class = cinder.backup.api.API {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backup_name_template = backup-%s {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backup_use_same_host = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backup_use_temp_snapshot = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] chap_password = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] chap_username = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cinder_internal_tenant_project_id = 3404f19ba6d9415eadc6a0097c5625a7 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cinder_internal_tenant_user_id = 12708802fd12479abc7f6fee47cfbe00 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cloned_volume_same_az = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cluster = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] compression_format = gzip {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] compute_api_class = cinder.compute.nova.API {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] config_dir = [] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] config_source = [] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] control_exchange = openstack {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] debug = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] default_availability_zone = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] default_group_type = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] default_volume_type = lvmdriver-1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] driver_client_cert = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] driver_client_cert_key = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] driver_data_namespace = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] driver_ssl_cert_path = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] driver_ssl_cert_verify = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] driver_use_ssl = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] enable_force_upload = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] enable_new_services = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] enable_unsupported_driver = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] enforce_multipath_for_image_xfer = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] filter_function = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance_api_insecure = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance_api_ssl_compression = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance_ca_certificates_file = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance_catalog_info = image:glance:publicURL {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance_certfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance_keyfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance_num_retries = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance_request_timeout = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] goodness_function = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] graceful_shutdown_timeout = 5 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] group_api_class = cinder.group.api.API {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] host = devstack {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] image_compress_on_upload = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] image_conversion_address_space_limit = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] image_conversion_cpu_limit = 60 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] image_conversion_disable = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] image_upload_use_cinder_backend = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] image_upload_use_internal_tenant = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] image_volume_cache_enabled = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] image_volume_cache_max_count = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] image_volume_cache_max_size_gb = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] init_host_max_objects_retrieval = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] instance_format = [instance: %(uuid)s] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] iscsi_iotype = fileio {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] iscsi_target_flags = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] iscsi_write_cache = on {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] iser_helper = tgtadm {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] iser_ip_address = 192.168.122.201 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] iser_port = 3260 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76139]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] log_color = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] log_config_append = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] log_dir = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] log_file = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] log_options = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] log_rotate_interval = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] log_rotate_interval_type = days {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] log_rotation_type = none {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] max_age = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] max_logfile_count = 30 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] max_logfile_size_mb = 200 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] max_over_subscription_ratio = 20.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] message_reap_interval = 86400 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] message_ttl = 2592000 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] migration_create_volume_timeout_secs = 300 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] monkey_patch = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] monkey_patch_modules = [] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] my_ip = 192.168.122.201 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] no_snapshot_gb_quota = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] num_iser_scan_tries = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] num_shell_tries = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] num_volume_device_scan_tries = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] nvmeof_conn_info_version = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] nvmet_ns_id = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] nvmet_port_id = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] osapi_max_limit = 1000 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] osapi_volume_ext_list = [] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] osapi_volume_listen_port = 8776 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] osapi_volume_use_ssl = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] osapi_volume_workers = 2 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] per_volume_size_limit = -1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] periodic_fuzzy_delay = 60 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] periodic_interval = 60 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] public_endpoint = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] publish_errors = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] quota_backup_gigabytes = 1000 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] quota_backups = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] quota_gigabytes = 1000 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] quota_groups = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] quota_snapshots = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] quota_volumes = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] rate_limit_burst = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] rate_limit_except_level = CRITICAL {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] rate_limit_interval = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] reinit_driver_count = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] replication_device = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] report_discard_supported = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] report_interval = 120 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] reservation_clean_interval = 86400 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] reservation_expire = 86400 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] reserved_image_namespaces = [] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] reserved_percentage = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] rpc_response_timeout = 120 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] run_external_periodic_tasks = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] scst_target_driver = iscsi {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] scst_target_iqn_name = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] service_down_time = 720 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] shell_completion = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] snapshot_name_template = snapshot-%s {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] snapshot_same_host = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] split_loggers = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] state_path = /opt/stack/data/cinder {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] storage_availability_zone = nova {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] storage_protocol = iSCSI {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] syslog_log_facility = LOG_USER {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] target_helper = lioadm {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] target_ip_address = 192.168.122.201 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] target_port = 3260 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] target_protocol = iscsi {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] target_secondary_ip_addresses = [] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] trace_flags = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] transport_url = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] until_refresh = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] use_chap_auth = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] use_default_quota_class = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] use_journal = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] use_json = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] use_multipath_for_image_xfer = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] use_stderr = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] use_syslog = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] verify_glance_signatures = enabled {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_api_class = cinder.volume.api.API {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_backend_name = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_clear = zero {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_clear_ionice = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_clear_size = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_copy_bps_limit = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_dd_blocksize = 1M {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_name_template = volume-%s {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_service_inithost_offload = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volume_usage_audit_period = month {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] watch_log_file = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] zoning_mode = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_concurrency.disable_process_locking = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.admin_password = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.admin_token = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.admin_user = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.auth_admin_prefix = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.auth_port = 35357 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.auth_protocol = https {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.auth_section = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.auth_type = password {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.auth_uri = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.auth_version = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.cache = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.certfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.identity_uri = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.include_service_catalog = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.insecure = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.interface = public {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.keyfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_password = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcache_username = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.region_name = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.service_token_roles_required = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.service_type = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.backend = dogpile.cache.null {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.backend_argument = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.backend_expiration_time = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.config_prefix = cache.oslo {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.dead_timeout = 60.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.debug_cache_backend = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.enable_retry_client = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.enable_socket_keepalive = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.enabled = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.enforce_fips_mode = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.expiration_time = 600 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.hashclient_retry_attempts = 2 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.hashclient_retry_delay = 1.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.memcache_dead_retry = 300 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.memcache_password = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.memcache_pool_maxsize = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.memcache_sasl_enabled = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.memcache_socket_timeout = 1.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.memcache_username = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.proxies = [] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.redis_db = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.redis_password = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.redis_server = localhost:6379 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.redis_socket_timeout = 1.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.redis_username = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.retry_attempts = 2 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.retry_delay = 0.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.socket_keepalive_count = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.socket_keepalive_idle = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.socket_keepalive_interval = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.tls_allowed_ciphers = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.tls_cafile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.tls_certfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.tls_enabled = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cache.tls_keyfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] coordination.backend_url = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.asyncio_connection = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.asyncio_slave_connection = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.backend = sqlalchemy {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.connection = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.connection_debug = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.connection_parameters = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.connection_recycle_time = 3600 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.connection_trace = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.db_inc_retry_interval = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.db_max_retries = 20 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.db_max_retry_interval = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.db_retry_interval = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.max_overflow = 50 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.max_pool_size = 5 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.max_retries = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.mysql_wsrep_sync_wait = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.pool_timeout = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.retry_interval = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.slave_connection = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.sqlite_synchronous = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] database.use_db_reconnect = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler.connection_string = messaging:// {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler.enabled = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler.es_doc_type = notification {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler.es_scroll_size = 10000 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler.es_scroll_time = 2m {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler.filter_error_trace = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler.hmac_keys = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler.sentinel_service_name = mymaster {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler.socket_timeout = 0.1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler.trace_requests = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler.trace_sqlalchemy = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler_jaeger.process_tags = {} {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler_jaeger.service_name_prefix = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] profiler_otlp.service_name_prefix = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_policy.enforce_new_defaults = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: WARNING oslo_config.cfg [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_policy.enforce_scope = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_policy.policy_default_rule = default {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_policy.policy_file = policy.yaml {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] privsep_osbrick.group = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] privsep_osbrick.helper_command = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] privsep_osbrick.user = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cinder_sys_admin.group = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cinder_sys_admin.helper_command = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] cinder_sys_admin.user = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] service_user.auth_section = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] service_user.auth_type = password {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] service_user.certfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] service_user.collect_timing = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] service_user.insecure = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] service_user.keyfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] service_user.send_service_user_token = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] service_user.split_loggers = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] service_user.timeout = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance.auth_section = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance.auth_type = password {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance.certfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance.collect_timing = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance.insecure = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance.keyfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance.split_loggers = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] glance.timeout = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.backend_availability_zone = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.chap_password = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.chap_username = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.driver_client_cert = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.driver_client_cert_key = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.driver_data_namespace = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.driver_use_ssl = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.extra_capabilities = {} {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.filter_function = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.goodness_function = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.iscsi_iotype = fileio {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.iscsi_target_flags = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.iscsi_write_cache = on {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.iser_helper = tgtadm {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.iser_port = 3260 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.lvm_share_target = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.lvm_type = auto {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.num_shell_tries = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76139]: INFO cinder.volume.manager [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.replication_device = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.report_discard_supported = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.reserved_percentage = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.target_helper = tgtadm {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.target_port = 3260 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.target_protocol = iscsi {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.trace_flags = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.unique_fqdn_network = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.use_chap_auth = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.volume_backend_name = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.volume_clear = zero {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.volume_clear_ionice = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.volume_clear_size = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_reports.file_event_handler = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_reports.log_dir = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:32 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.backend_host = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.chap_password = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.chap_username = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.driver_client_cert = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.extra_capabilities = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.filter_function = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.goodness_function = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.iscsi_iotype = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.iser_helper = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.iser_ip_address = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.iser_port = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.lvm_share_target = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.lvm_type = auto {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.num_shell_tries = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.replication_device = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.report_discard_supported = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.reserved_percentage = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.scst_target_driver = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.storage_protocol = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.target_helper = lioadm {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.target_ip_address = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.target_port = 3260 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.trace_flags = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.use_chap_auth = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.volume_clear = zero {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.volume_clear_size = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] lvmdriver-1.volumes_dir = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.ssl = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_notifications.driver = [] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_notifications.retry = -1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] key_manager.fixed_key = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.barbican_api_version = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.barbican_endpoint = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.barbican_endpoint_type = public {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.barbican_region_name = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.cafile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.certfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.collect_timing = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.insecure = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.keyfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.number_of_retries = 60 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.retry_delay = 1 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.send_service_user_token = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.split_loggers = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.timeout = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.verify_ssl = True {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican.verify_ssl_path = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican_service_user.auth_section = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican_service_user.auth_type = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican_service_user.cafile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican_service_user.certfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican_service_user.collect_timing = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican_service_user.insecure = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican_service_user.keyfile = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican_service_user.split_loggers = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] barbican_service_user.timeout = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vault.approle_role_id = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vault.approle_secret_id = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vault.kv_mountpoint = secret {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vault.kv_path = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vault.kv_version = 2 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vault.namespace = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vault.root_token_id = **** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vault.ssl_ca_crt_file = None {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vault.timeout = 60.0 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vault.use_ssl = False {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:02:33 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] ******************************************************************************** {{(pid=76006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 17 18:02:33 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.225s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:33 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:33 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.091s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:33 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:33 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.089s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:33 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:33 devstack sudo[76216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 17 18:02:33 devstack sudo[76216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:02:35 devstack sudo[76216]: pam_unix(sudo:session): session closed for user root Sep 17 18:02:35 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.048s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:35 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:35 devstack sudo[76325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:02:35 devstack sudo[76325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:02:37 devstack sudo[76325]: pam_unix(sudo:session): session closed for user root Sep 17 18:02:37 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.954s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:37 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:02:37 devstack cinder-volume[76139]: INFO cinder.brick.local_dev.lvm [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 17 18:02:37 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:37 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.073s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:37 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:37 devstack sudo[76420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 18:02:37 devstack sudo[76420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:02:39 devstack sudo[76420]: pam_unix(sudo:session): session closed for user root Sep 17 18:02:39 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.990s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:39 devstack cinder-volume[76139]: DEBUG cinder.brick.local_dev.lvm [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76139) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 17 18:02:39 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:39 devstack sudo[76519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:02:39 devstack sudo[76519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:02:42 devstack cinder-volume[76006]: DEBUG dbcounter [-] [76006] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76006) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:02:43 devstack sudo[76519]: pam_unix(sudo:session): session closed for user root Sep 17 18:02:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.604s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.072s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:43 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:43 devstack sudo[76706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:02:43 devstack sudo[76706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:02:45 devstack sudo[76706]: pam_unix(sudo:session): session closed for user root Sep 17 18:02:45 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.040s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:45 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:45 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.071s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:45 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:45 devstack sudo[76743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 17 18:02:45 devstack sudo[76743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:02:47 devstack sudo[76743]: pam_unix(sudo:session): session closed for user root Sep 17 18:02:47 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.076s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:47 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:47 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 18:02:47 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:02:50 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Sep 17 18:02:50 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.663s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:50 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:50 devstack sudo[76835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 18:02:50 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:02:52 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root Sep 17 18:02:52 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.519s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:52 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:53 devstack sudo[76840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:02:53 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:02:55 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root Sep 17 18:02:55 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.721s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:55 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:55 devstack sudo[76845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:02:55 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:02:57 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root Sep 17 18:02:57 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.092s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:57 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:57 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.133s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:57 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:02:58 devstack sudo[76855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:02:58 devstack sudo[76855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:02:59 devstack sudo[76855]: pam_unix(sudo:session): session closed for user root Sep 17 18:02:59 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.996s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:02:59 devstack cinder-volume[76139]: INFO cinder.volume.drivers.lvm [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 17 18:02:59 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:00 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.069s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:00 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:00 devstack sudo[76969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:03:00 devstack sudo[76969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:01 devstack sudo[76969]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:01 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.909s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:01 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 18:03:01 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:02 devstack sudo[77074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 18:03:02 devstack sudo[77074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:03 devstack sudo[77074]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:03 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.953s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:03 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:04 devstack sudo[77114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:03:04 devstack sudo[77114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:05 devstack sudo[77114]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:05 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.960s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:05 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:06 devstack sudo[77117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:03:06 devstack sudo[77117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:07 devstack sudo[77117]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:07 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.846s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:07 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:07 devstack sudo[77122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:03:07 devstack sudo[77122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:09 devstack sudo[77122]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:09 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.912s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:09 devstack cinder-volume[76139]: INFO cinder.volume.driver [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Driver hasn't implemented _init_vendor_properties() Sep 17 18:03:09 devstack cinder-volume[76139]: DEBUG cinder.volume.driver [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76139) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 17 18:03:09 devstack cinder-volume[76139]: DEBUG oslo_db.sqlalchemy.engines [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 18:03:10 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writer thread running {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 17 18:03:10 devstack cinder-volume[76139]: DEBUG cinder.db.sqlalchemy.api [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Building query based on filter {{(pid=76139) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 17 18:03:10 devstack cinder-volume[76139]: DEBUG cinder.image.image_utils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76139) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 17 18:03:10 devstack cinder-volume[76139]: INFO cinder.keymgr.migration [None req-5079e324-a7b7-493f-9957-821bcd895235 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 18:03:10 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 18:03:10 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:10 devstack sudo[77129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 18:03:10 devstack sudo[77129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:12 devstack sudo[77129]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:12 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.909s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:12 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:12 devstack sudo[77223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:03:12 devstack sudo[77223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:14 devstack sudo[77223]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:14 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.221s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:14 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:14 devstack sudo[77311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:03:14 devstack sudo[77311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:16 devstack sudo[77311]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:16 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.121s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:16 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:16 devstack sudo[77316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:03:16 devstack sudo[77316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:18 devstack sudo[77316]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:18 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.701s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:18 devstack cinder-volume[76139]: DEBUG cinder.manager [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Notifying Schedulers of capabilities ... {{(pid=76139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:03:18 devstack cinder-volume[76139]: INFO cinder.volume.manager [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Driver initialization completed successfully. Sep 17 18:03:18 devstack cinder-volume[76139]: INFO cinder.manager [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Initiating service 2 cleanup Sep 17 18:03:18 devstack cinder-volume[76139]: INFO cinder.manager [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Service 2 cleanup completed. Sep 17 18:03:18 devstack cinder-volume[76139]: DEBUG cinder.service [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Creating RPC server for service cinder-volume {{(pid=76139) start /opt/stack/cinder/cinder/service.py:239}} Sep 17 18:03:18 devstack cinder-volume[76139]: DEBUG cinder.service [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76139) start /opt/stack/cinder/cinder/service.py:245}} Sep 17 18:03:18 devstack cinder-volume[76139]: INFO cinder.volume.manager [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 17 18:03:18 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 18:03:18 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:18 devstack sudo[77319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 18:03:18 devstack sudo[77319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:20 devstack sudo[77319]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:20 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.000s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:20 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:20 devstack sudo[77328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:03:20 devstack sudo[77328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:23 devstack sudo[77328]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:23 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.251s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:23 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:24 devstack sudo[77336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:03:24 devstack sudo[77336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:25 devstack sudo[77336]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:25 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.963s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:25 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:03:26 devstack sudo[77339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:03:26 devstack sudo[77339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:03:27 devstack sudo[77339]: pam_unix(sudo:session): session closed for user root Sep 17 18:03:27 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.736s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:03:27 devstack cinder-volume[76139]: INFO cinder.volume.manager [None req-24ec50bb-52a1-42dd-9f80-b6f314364198 None None] Driver post RPC initialization completed successfully. Sep 17 18:03:28 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:SELECT=2 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:03:37 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:04:13 devstack cinder-volume[76139]: DEBUG oslo_service.periodic_task [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:04:13 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 18:04:13 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:04:13 devstack sudo[78297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 18:04:13 devstack sudo[78297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:04:15 devstack sudo[78297]: pam_unix(sudo:session): session closed for user root Sep 17 18:04:16 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.121s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:04:16 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:04:16 devstack sudo[78330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:04:16 devstack sudo[78330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:04:17 devstack sudo[78330]: pam_unix(sudo:session): session closed for user root Sep 17 18:04:17 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.842s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:04:17 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:04:18 devstack sudo[78372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:04:18 devstack sudo[78372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:04:19 devstack sudo[78372]: pam_unix(sudo:session): session closed for user root Sep 17 18:04:19 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.910s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:04:19 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:04:19 devstack sudo[78467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:04:19 devstack sudo[78467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:04:21 devstack sudo[78467]: pam_unix(sudo:session): session closed for user root Sep 17 18:04:21 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.957s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:04:21 devstack cinder-volume[76139]: DEBUG cinder.manager [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Notifying Schedulers of capabilities ... {{(pid=76139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:05:13 devstack cinder-volume[76139]: DEBUG oslo_service.periodic_task [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:05:13 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 18:05:13 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:05:13 devstack sudo[79070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 18:05:13 devstack sudo[79070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:05:15 devstack sudo[79070]: pam_unix(sudo:session): session closed for user root Sep 17 18:05:15 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.988s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:05:15 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:05:16 devstack sudo[79100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:05:16 devstack sudo[79100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:05:18 devstack sudo[79100]: pam_unix(sudo:session): session closed for user root Sep 17 18:05:18 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.245s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:05:18 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:05:18 devstack sudo[79135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:05:18 devstack sudo[79135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:05:20 devstack sudo[79135]: pam_unix(sudo:session): session closed for user root Sep 17 18:05:20 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.938s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:05:20 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:05:20 devstack sudo[79150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:05:20 devstack sudo[79150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:05:22 devstack sudo[79150]: pam_unix(sudo:session): session closed for user root Sep 17 18:05:22 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.944s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:05:22 devstack cinder-volume[76139]: DEBUG cinder.manager [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Notifying Schedulers of capabilities ... {{(pid=76139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:05:38 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:06:13 devstack cinder-volume[76139]: DEBUG oslo_service.periodic_task [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:06:13 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 18:06:13 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:06:13 devstack sudo[81816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 18:06:13 devstack sudo[81816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:06:15 devstack sudo[81816]: pam_unix(sudo:session): session closed for user root Sep 17 18:06:15 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.058s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:06:15 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:06:16 devstack sudo[81966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:06:16 devstack sudo[81966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:06:17 devstack sudo[81966]: pam_unix(sudo:session): session closed for user root Sep 17 18:06:18 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.034s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:06:18 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:06:18 devstack sudo[82111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:06:18 devstack sudo[82111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:06:20 devstack sudo[82111]: pam_unix(sudo:session): session closed for user root Sep 17 18:06:20 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.309s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:06:20 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:06:20 devstack sudo[82221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:06:20 devstack sudo[82221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:06:22 devstack sudo[82221]: pam_unix(sudo:session): session closed for user root Sep 17 18:06:22 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.136s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:06:22 devstack cinder-volume[76139]: DEBUG cinder.manager [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Notifying Schedulers of capabilities ... {{(pid=76139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:07:13 devstack cinder-volume[76139]: DEBUG oslo_service.periodic_task [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:07:13 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 18:07:13 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:07:13 devstack sudo[82382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 18:07:13 devstack sudo[82382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:07:15 devstack sudo[82382]: pam_unix(sudo:session): session closed for user root Sep 17 18:07:15 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.873s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:07:15 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:07:15 devstack sudo[82390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:07:15 devstack sudo[82390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:07:17 devstack sudo[82390]: pam_unix(sudo:session): session closed for user root Sep 17 18:07:17 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.765s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:07:17 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:07:17 devstack sudo[82405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:07:17 devstack sudo[82405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:07:19 devstack sudo[82405]: pam_unix(sudo:session): session closed for user root Sep 17 18:07:19 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.753s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:07:19 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:07:19 devstack sudo[82411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:07:19 devstack sudo[82411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:07:21 devstack sudo[82411]: pam_unix(sudo:session): session closed for user root Sep 17 18:07:21 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.297s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:07:21 devstack cinder-volume[76139]: DEBUG cinder.manager [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Notifying Schedulers of capabilities ... {{(pid=76139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:07:37 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:SELECT=1 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:07:37 devstack cinder-volume[76139]: DEBUG dbcounter [-] [76139] Writing DB stats cinder:UPDATE=1 {{(pid=76139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:08:13 devstack cinder-volume[76139]: DEBUG oslo_service.periodic_task [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:08:13 devstack cinder-volume[76139]: DEBUG cinder.volume.drivers.lvm [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Updating volume stats {{(pid=76139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 18:08:13 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:08:13 devstack sudo[82606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 18:08:13 devstack sudo[82606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:08:15 devstack sudo[82606]: pam_unix(sudo:session): session closed for user root Sep 17 18:08:15 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.757s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:08:15 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:08:15 devstack sudo[82609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:08:15 devstack sudo[82609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:08:17 devstack sudo[82609]: pam_unix(sudo:session): session closed for user root Sep 17 18:08:17 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.965s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:08:17 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:08:17 devstack sudo[82619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 18:08:17 devstack sudo[82619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:08:19 devstack sudo[82619]: pam_unix(sudo:session): session closed for user root Sep 17 18:08:19 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.004s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:08:19 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:08:19 devstack sudo[82624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 18:08:19 devstack sudo[82624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:08:21 devstack sudo[82624]: pam_unix(sudo:session): session closed for user root Sep 17 18:08:22 devstack cinder-volume[76139]: DEBUG oslo_concurrency.processutils [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.301s {{(pid=76139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:08:22 devstack cinder-volume[76139]: DEBUG cinder.manager [None req-96e1d4cf-74bc-419b-8e82-a02efa51e71d None None] Notifying Schedulers of capabilities ... {{(pid=76139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:08:50 devstack cinder-volume[76006]: INFO oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Caught SIGTERM, stopping children Sep 17 18:08:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.lockutils [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Acquiring lock "singleton_lock" {{(pid=76006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 17 18:08:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.lockutils [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Acquired lock "singleton_lock" {{(pid=76006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 17 18:08:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.lockutils [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Releasing lock "singleton_lock" {{(pid=76006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 17 18:08:50 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Stop services. {{(pid=76006) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 17 18:08:50 devstack cinder-volume[76006]: DEBUG oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Killing children. {{(pid=76006) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 17 18:08:50 devstack cinder-volume[76006]: INFO oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Waiting on 1 children to exit Sep 17 18:08:53 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Acquiring lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 17 18:08:53 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Acquired lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 17 18:08:53 devstack cinder-volume[76139]: DEBUG oslo_concurrency.lockutils [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Releasing lock "singleton_lock" {{(pid=76139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 17 18:08:53 devstack cinder-volume[76139]: WARNING amqp [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 18:08:53 devstack cinder-volume[76139]: WARNING amqp [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 18:08:53 devstack cinder-volume[76006]: INFO oslo_service.backend._eventlet.service [None req-be556b0a-9fc2-4569-bc0d-c0d783ca64f7 None None] Child 76139 exited with status 0 Sep 17 18:09:10 devstack cinder-volume[83523]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 17 18:09:10 devstack cinder-volume[83523]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 17 18:09:10 devstack cinder-volume[83523]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 17 18:09:13 devstack cinder-volume[83523]: INFO dbcounter [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Registered counter for database cinder Sep 17 18:09:13 devstack cinder-volume[83523]: DEBUG oslo_db.sqlalchemy.engines [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG dbcounter [-] [83523] Writer thread running {{(pid=83523) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 17 18:09:14 devstack cinder-volume[83523]: INFO cinder.rpc [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 18:09:14 devstack cinder-volume[83523]: INFO cinder.rpc [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_db.sqlalchemy.engines [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 18:09:14 devstack cinder-volume[83523]: INFO cinder.volume.manager [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Determined volume DB was empty at startup. Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG cinder.volume.manager [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83523) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 17 18:09:14 devstack cinder-volume[83523]: INFO cinder.volume.manager [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 18:09:14 devstack cinder-volume[83523]: WARNING stevedore.named [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 18:09:14 devstack cinder-volume[83523]: WARNING castellan.key_manager [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 18:09:14 devstack cinder-volume[83523]: WARNING cinder.keymgr.conf_key_mgr [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 18:09:14 devstack cinder-volume[83523]: INFO cinder.volume.manager [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_db.sqlalchemy.engines [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 18:09:14 devstack cinder-volume[83523]: INFO oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Starting 1 workers Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Started child 83736 {{(pid=83523) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Full set of CONF: {{(pid=83523) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] ******************************************************************************** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Configuration options gathered from: {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] ================================================================================ {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] allow_availability_zone_fallback = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] allow_compression_on_image_upload = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] allowed_direct_url_schemes = [] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] api_rate_limit = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] auth_strategy = keystone {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_availability_zone = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_host = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_name = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_stats_polling_interval = 60 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backup_api_class = cinder.backup.api.API {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backup_name_template = backup-%s {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backup_use_same_host = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backup_use_temp_snapshot = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] chap_password = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] chap_username = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cinder_internal_tenant_project_id = 3404f19ba6d9415eadc6a0097c5625a7 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cinder_internal_tenant_user_id = 12708802fd12479abc7f6fee47cfbe00 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cluster = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] compression_format = gzip {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] compute_api_class = cinder.compute.nova.API {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] config_dir = [] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] config_source = [] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] control_exchange = openstack {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] debug = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] default_availability_zone = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] default_group_type = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] default_volume_type = QuobyteHD {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] driver_client_cert = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] driver_client_cert_key = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] driver_data_namespace = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] driver_ssl_cert_path = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] driver_ssl_cert_verify = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] driver_use_ssl = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] enable_new_services = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] enable_unsupported_driver = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] enabled_backends = ['QuobyteHD'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] enforce_multipath_for_image_xfer = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] filter_function = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance_api_insecure = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance_api_ssl_compression = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance_ca_certificates_file = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance_catalog_info = image:glance:publicURL {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance_certfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83736]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance_keyfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance_num_retries = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance_request_timeout = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] goodness_function = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] graceful_shutdown_timeout = 5 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] group_api_class = cinder.group.api.API {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] host = devstack {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] image_compress_on_upload = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] image_conversion_address_space_limit = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] image_conversion_cpu_limit = 60 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] image_conversion_disable = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] image_upload_use_cinder_backend = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] image_upload_use_internal_tenant = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] image_volume_cache_enabled = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] image_volume_cache_max_count = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] image_volume_cache_max_size_gb = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] init_host_max_objects_retrieval = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] instance_format = [instance: %(uuid)s] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] iscsi_iotype = fileio {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] iscsi_target_flags = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] iscsi_write_cache = on {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] iser_helper = tgtadm {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] iser_ip_address = 192.168.122.201 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] iser_port = 3260 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] log_color = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] log_config_append = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] log_dir = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] log_file = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] log_options = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] log_rotate_interval = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] log_rotate_interval_type = days {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] log_rotation_type = none {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] max_age = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] max_logfile_count = 30 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] max_logfile_size_mb = 200 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] max_over_subscription_ratio = 20.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] message_reap_interval = 86400 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] message_ttl = 2592000 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] migration_create_volume_timeout_secs = 300 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] monkey_patch = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] monkey_patch_modules = [] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] my_ip = 192.168.122.201 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] no_snapshot_gb_quota = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] num_iser_scan_tries = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] num_shell_tries = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] num_volume_device_scan_tries = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] nvmeof_conn_info_version = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] nvmet_ns_id = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] nvmet_port_id = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] osapi_max_limit = 1000 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] osapi_volume_ext_list = [] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] osapi_volume_listen_port = 8776 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] osapi_volume_use_ssl = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] osapi_volume_workers = 2 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] per_volume_size_limit = -1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] periodic_fuzzy_delay = 60 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] periodic_interval = 60 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] public_endpoint = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] publish_errors = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] quota_backup_gigabytes = 1000 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] quota_backups = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] quota_gigabytes = 1000 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] quota_groups = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] quota_snapshots = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] quota_volumes = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] rate_limit_burst = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] rate_limit_except_level = CRITICAL {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] rate_limit_interval = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] reinit_driver_count = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] replication_device = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] report_discard_supported = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] report_interval = 120 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] reservation_clean_interval = 86400 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] reservation_expire = 86400 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] reserved_image_namespaces = [] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] reserved_percentage = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] rpc_response_timeout = 120 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] run_external_periodic_tasks = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] scst_target_driver = iscsi {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] scst_target_iqn_name = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] service_down_time = 720 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] shell_completion = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] snapshot_name_template = snapshot-%s {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] split_loggers = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] state_path = /opt/stack/data/cinder {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] storage_availability_zone = nova {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] storage_protocol = iSCSI {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] syslog_log_facility = LOG_USER {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] target_helper = lioadm {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] target_ip_address = 192.168.122.201 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] target_port = 3260 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] target_protocol = iscsi {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] target_secondary_ip_addresses = [] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] trace_flags = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] transport_url = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] until_refresh = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] use_chap_auth = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] use_default_quota_class = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] use_journal = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] use_json = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] use_multipath_for_image_xfer = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] use_stderr = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] use_syslog = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] verify_glance_signatures = enabled {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_api_class = cinder.volume.api.API {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_backend_name = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_clear = zero {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_clear_ionice = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_clear_size = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_copy_bps_limit = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_dd_blocksize = 1M {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_name_template = volume-%s {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_service_inithost_offload = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volume_usage_audit_period = month {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] watch_log_file = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] zoning_mode = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_concurrency.disable_process_locking = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.admin_password = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.admin_token = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.admin_user = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.auth_port = 35357 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.auth_protocol = https {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.auth_section = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.auth_type = password {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.auth_uri = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.auth_version = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.cache = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.certfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.identity_uri = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.include_service_catalog = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.insecure = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.interface = public {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.keyfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_password = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcache_username = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.region_name = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.service_type = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.backend = dogpile.cache.null {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.backend_argument = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.backend_expiration_time = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.config_prefix = cache.oslo {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.dead_timeout = 60.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.debug_cache_backend = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.enable_retry_client = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.enable_socket_keepalive = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.enabled = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.enforce_fips_mode = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.expiration_time = 600 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.hashclient_retry_attempts = 2 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.hashclient_retry_delay = 1.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.memcache_dead_retry = 300 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.memcache_password = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.memcache_pool_maxsize = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.memcache_sasl_enabled = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.memcache_socket_timeout = 1.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.memcache_username = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.proxies = [] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.redis_db = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.redis_password = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.redis_server = localhost:6379 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.redis_socket_timeout = 1.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.redis_username = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.retry_attempts = 2 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.retry_delay = 0.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.socket_keepalive_count = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.socket_keepalive_idle = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.socket_keepalive_interval = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.tls_allowed_ciphers = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.tls_cafile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.tls_certfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.tls_enabled = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cache.tls_keyfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] coordination.backend_url = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.asyncio_connection = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.asyncio_slave_connection = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.backend = sqlalchemy {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.connection = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.connection_debug = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.connection_parameters = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.connection_recycle_time = 3600 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.connection_trace = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.db_inc_retry_interval = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.db_max_retries = 20 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.db_max_retry_interval = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.db_retry_interval = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.max_overflow = 50 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.max_pool_size = 5 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.max_retries = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.mysql_wsrep_sync_wait = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.pool_timeout = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.retry_interval = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.slave_connection = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.sqlite_synchronous = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] database.use_db_reconnect = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler.connection_string = messaging:// {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler.enabled = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler.es_doc_type = notification {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler.es_scroll_size = 10000 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler.es_scroll_time = 2m {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler.filter_error_trace = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler.hmac_keys = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler.sentinel_service_name = mymaster {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler.socket_timeout = 0.1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler.trace_requests = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler.trace_sqlalchemy = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler_jaeger.process_tags = {} {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler_jaeger.service_name_prefix = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Starting volume driver QuobyteDriver (1.1.13) Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] profiler_otlp.service_name_prefix = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_policy.enforce_new_defaults = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83736) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 17 18:09:14 devstack cinder-volume[83523]: WARNING oslo_config.cfg [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_policy.enforce_scope = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_policy.policy_default_rule = default {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_policy.policy_file = policy.yaml {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] privsep_osbrick.group = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] privsep_osbrick.helper_command = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] privsep_osbrick.user = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cinder_sys_admin.group = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cinder_sys_admin.helper_command = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] cinder_sys_admin.user = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] service_user.auth_section = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] service_user.auth_type = password {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] service_user.certfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] service_user.collect_timing = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] service_user.insecure = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] service_user.keyfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] service_user.send_service_user_token = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] service_user.split_loggers = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] service_user.timeout = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance.auth_section = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance.auth_type = password {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance.certfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance.collect_timing = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance.insecure = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance.keyfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance.split_loggers = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] glance.timeout = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.backend_availability_zone = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.chap_password = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.chap_username = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.driver_client_cert = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.driver_client_cert_key = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.driver_data_namespace = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.driver_use_ssl = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.extra_capabilities = {} {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.filter_function = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.goodness_function = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.iscsi_iotype = fileio {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.iscsi_target_flags = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.iscsi_write_cache = on {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.iser_helper = tgtadm {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.iser_port = 3260 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nas_host = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nas_login = admin {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nas_mount_options = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nas_password = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nas_private_key = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nas_share_path = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.num_shell_tries = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.quobyte_volume_url = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.replication_device = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.report_discard_supported = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.reserved_percentage = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.target_helper = tgtadm {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.target_port = 3260 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.target_protocol = iscsi {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.trace_flags = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.unique_fqdn_network = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.use_chap_auth = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.volume_backend_name = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.volume_clear = zero {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.volume_clear_ionice = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.volume_clear_size = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_reports.file_event_handler = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_reports.log_dir = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.backend_availability_zone = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.backend_host = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.chap_password = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.chap_username = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.chiscsi_conf = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.driver_client_cert = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.driver_data_namespace = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.driver_use_ssl = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.extra_capabilities = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.filter_function = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.goodness_function = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.iscsi_iotype = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.iser_helper = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.iser_ip_address = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.iser_port = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.iser_target_prefix = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nas_host = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nas_login = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nas_mount_options = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nas_password = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nas_private_key = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nas_share_path = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nas_ssh_port = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.num_shell_tries = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.nvmet_port_id = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.replication_device = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.report_discard_supported = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.reserved_percentage = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.scst_target_driver = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.storage_protocol = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.target_helper = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.target_ip_address = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.target_port = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.target_prefix = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.target_protocol = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.trace_flags = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.use_chap_auth = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.volume_clear = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.volume_clear_size = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] QuobyteHD.volumes_dir = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.ssl = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_notifications.driver = [] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_notifications.retry = -1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] key_manager.fixed_key = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.barbican_api_version = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.barbican_endpoint = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.barbican_endpoint_type = public {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.barbican_region_name = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.cafile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.certfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.collect_timing = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.insecure = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.keyfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.number_of_retries = 60 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.retry_delay = 1 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.send_service_user_token = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.split_loggers = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.timeout = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.verify_ssl = True {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican.verify_ssl_path = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican_service_user.auth_section = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican_service_user.auth_type = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican_service_user.cafile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican_service_user.certfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican_service_user.collect_timing = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican_service_user.insecure = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican_service_user.keyfile = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican_service_user.split_loggers = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] barbican_service_user.timeout = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vault.approle_role_id = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vault.approle_secret_id = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vault.kv_mountpoint = secret {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83736) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 17 18:09:14 devstack cinder-volume[83736]: INFO cinder.volume.drivers.quobyte [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vault.kv_path = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vault.kv_version = 2 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vault.namespace = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vault.root_token_id = **** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vault.ssl_ca_crt_file = None {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vault.timeout = 60.0 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vault.use_ssl = False {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 18:09:14 devstack cinder-volume[83523]: DEBUG oslo_service.backend._eventlet.service [None req-9dde2eae-1713-4811-ada5-f35cce88d314 None None] ******************************************************************************** {{(pid=83523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 17 18:09:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Running cmd (subprocess): mount.quobyte {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:09:15 devstack quobyte-client[83737]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 18:09:15 devstack quobyte-client[83737]: Invalid parameters found, error: missing mount point. Sep 17 18:09:15 devstack quobyte-client[83737]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 18:09:15 devstack quobyte-client[83737]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] CMD "mount.quobyte" returned: 1 in 0.237s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:09:15 devstack cinder-volume[83736]: INFO cinder.volume.drivers.quobyte [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Mounting volume: 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a ... Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 -c /etc/quobyte/client-cinder.cfg {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:09:15 devstack quobyte-client[83738]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 17 18:09:15 devstack quobyte-client[83738]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 18:09:15 devstack quobyte-client[83738]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1' to display the log. Sep 17 18:09:15 devstack quobyte-client[83739]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 17 18:09:15 devstack quobyte-client[83739]: mount.quobyte 3.25 (4fbbd59204) Sep 17 18:09:15 devstack quobyte-client[83739]: Client UUID: MU5VuyNk-Ulit-ybb6-bfpa-9UZMecYXWdIy Sep 17 18:09:15 devstack quobyte-client[83739]: Registry: osci01.corp.quobyte.com:7861 Sep 17 18:09:15 devstack quobyte-client[83739]: Volume: cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:09:15 devstack quobyte-client[83739]: FUSE version: 316 Sep 17 18:09:15 devstack quobyte-client[83739]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 17 18:09:15 devstack quobyte-client[83739]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 17 18:09:15 devstack quobyte-client[83739]: Setting total object cache size to 3352297472 bytes Sep 17 18:09:15 devstack quobyte-client[83739]: Using FUSE low-level API Sep 17 18:09:15 devstack quobyte-client[83739]: Caching of uid/gid to user/group name mappings is enabled Sep 17 18:09:15 devstack quobyte-client[83739]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 17 18:09:15 devstack quobyte-client[83739]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 17 18:09:15 devstack quobyte-client[83739]: HTTP server started on port 55000 Sep 17 18:09:15 devstack quobyte-client[83739]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 17 18:09:15 devstack quobyte-client[83739]: Mount point /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 established Sep 17 18:09:15 devstack quobyte-client[83739]: TimeSync is running and remote sync every 60 seconds Sep 17 18:09:15 devstack quobyte-client[83739]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 18:09:15 devstack quobyte-client[83739]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 18:09:15 devstack quobyte-client[83739]: Opening volume cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a (b747059c-dbbb-4527-95f0-7aac07684036) Sep 17 18:09:15 devstack quobyte-client[83739]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 17 18:09:15 devstack quobyte-client[83739]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 18:09:15 devstack quobyte-client[83739]: Failed to invalidate inode: 38: Function not implemented Sep 17 18:09:15 devstack quobyte-client[83739]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 18:09:15 devstack quobyte-client[83739]: Automatic minidump upload enabled by global system configuration Sep 17 18:09:15 devstack quobyte-client[83739]: Announcing HTTP status server address 172.24.4.1 Sep 17 18:09:15 devstack quobyte-client[83739]: Registered as service (uuid MU5VuyNk-Ulit-ybb6-bfpa-9UZMecYXWdIy) Sep 17 18:09:15 devstack quobyte-client[83739]: Quobyte Client running as pid 83739 Sep 17 18:09:15 devstack quobyte-client[83739]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 17 18:09:15 devstack quobyte-client[83739]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.502s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:09:15 devstack cinder-volume[83736]: INFO cinder.volume.drivers.quobyte [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Mounting volume: 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a succeeded Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.563s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:09:15 devstack quobyte-client[83739]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.063s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:09:15 devstack cinder-volume[83736]: INFO cinder.volume.driver [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Driver hasn't implemented _init_vendor_properties() Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG cinder.volume.driver [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83736) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 17 18:09:15 devstack cinder-volume[83736]: DEBUG oslo_db.sqlalchemy.engines [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writer thread running {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG cinder.db.sqlalchemy.api [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Building query based on filter {{(pid=83736) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83736) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 17 18:09:16 devstack cinder-volume[83736]: INFO cinder.keymgr.migration [None req-ee56da53-02ef-4ec2-9a35-8c221e518e31 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.067s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:09:16 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Driver initialization completed successfully. Sep 17 18:09:16 devstack cinder-volume[83736]: INFO cinder.manager [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Initiating service 3 cleanup Sep 17 18:09:16 devstack cinder-volume[83736]: INFO cinder.manager [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Service 3 cleanup completed. Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG cinder.service [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Creating RPC server for service cinder-volume {{(pid=83736) start /opt/stack/cinder/cinder/service.py:239}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG cinder.service [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83736) start /opt/stack/cinder/cinder/service.py:245}} Sep 17 18:09:16 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 17 18:09:16 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:09:16 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:09:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.093s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:09:17 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ff03a483-0def-42d2-b96b-a6e1ce9ef7bd None None] Driver post RPC initialization completed successfully. Sep 17 18:09:18 devstack quobyte-client[83739]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 18:09:24 devstack cinder-volume[83523]: DEBUG dbcounter [-] [83523] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83523) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:09:26 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:09:27 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:10:15 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:10:15 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Flow 'volume_create_manager' (88a1e584-540e-4d3f-98f6-576ce580fa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b812e5-9633-456d-8d1a-c42e2ef8c4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b812e5-9633-456d-8d1a-c42e2ef8c4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2037498658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b64c80-fd78-471b-814b-47903de894e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6adba1d892d54ac590cbca068d949eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:10:16Z,use_quota=True,user_id='d3897bcc43a84c0dbb02ff3b8a6c0a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d35fc3-6c3c-4fdf-9950-3dffd28623ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d35fc3-6c3c-4fdf-9950-3dffd28623ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29456c7-c11e-42c9-8685-117938c0663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29456c7-c11e-42c9-8685-117938c0663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b64c80-fd78-471b-814b-47903de894e2', 'volume_name': 'volume-77b64c80-fd78-471b-814b-47903de894e2', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf979c38-ea29-4eee-98ee-7ed016259fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf979c38-ea29-4eee-98ee-7ed016259fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cec40c-fa22-4cdf-b43a-2510cd44419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:17 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Volume 77b64c80-fd78-471b-814b-47903de894e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b64c80-fd78-471b-814b-47903de894e2', 'volume_size': 1} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2037498658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b64c80-fd78-471b-814b-47903de894e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6adba1d892d54ac590cbca068d949eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:10:16Z,use_quota=True,user_id='d3897bcc43a84c0dbb02ff3b8a6c0a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Creating volume 77b64c80-fd78-471b-814b-47903de894e2 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:10:17 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77b64c80-fd78-471b-814b-47903de894e2 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.791s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:10:17 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=2, name=volume-77b64c80-fd78-471b-814b-47903de894e2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77b64c80-fd78-471b-814b-47903de894e2 1073741824" returned: 0 in 0.744s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77b64c80-fd78-471b-814b-47903de894e2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77b64c80-fd78-471b-814b-47903de894e2" returned: 0 in 0.099s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] <== create_volume: return (909ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:10:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:10:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cec40c-fa22-4cdf-b43a-2510cd44419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b64c80-fd78-471b-814b-47903de894e2', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b98f1c-4799-4b8d-9afa-02aad013d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:18 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Volume volume-77b64c80-fd78-471b-814b-47903de894e2 (77b64c80-fd78-471b-814b-47903de894e2): created successfully Sep 17 18:10:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b98f1c-4799-4b8d-9afa-02aad013d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Flow 'volume_create_manager' (88a1e584-540e-4d3f-98f6-576ce580fa76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:10:18 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-5276c955-91ab-4e08-b5bc-8f75ed61c9d6 tempest-TaggedAttachmentsTest-1254444984 None] Created volume successfully. Sep 17 18:10:28 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:10:28 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:10:29 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Flow 'volume_create_manager' (f08bd0b6-7c8c-40c4-b76f-4732ee1ea395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e24eacd-6f5a-4174-9612-b88ef591c9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e24eacd-6f5a-4174-9612-b88ef591c9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-281494959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ca432ba3e44876a627ef8051bf21c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:10:29Z,use_quota=True,user_id='83884cbfd6bb483ab3323794ce4213e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cad170-97f0-41db-8b0f-38f4c0e08a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cad170-97f0-41db-8b0f-38f4c0e08a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a7340e-c2af-4ea5-9d94-239f93f68f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a7340e-c2af-4ea5-9d94-239f93f68f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311', 'volume_name': 'volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debc84b2-cc3a-4766-92e6-7faf2a38a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debc84b2-cc3a-4766-92e6-7faf2a38a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789e1c0b-0660-4ee8-a898-bac99602d2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:29 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Volume c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311', 'volume_size': 1} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-281494959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ca432ba3e44876a627ef8051bf21c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:10:29Z,use_quota=True,user_id='83884cbfd6bb483ab3323794ce4213e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Creating volume c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:10:29 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:10:29 devstack quobyte-client[83739]: System call of process 84384 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:10:29 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=3, name=volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311 1073741824" returned: 0 in 0.342s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311" returned: 0 in 0.071s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] <== create_volume: return (482ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.492s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789e1c0b-0660-4ee8-a898-bac99602d2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50705d7d-16d3-4790-b858-8d15bff5b18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:10:30 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Volume volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311 (c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311): created successfully Sep 17 18:10:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50705d7d-16d3-4790-b858-8d15bff5b18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:10:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Flow 'volume_create_manager' (f08bd0b6-7c8c-40c4-b76f-4732ee1ea395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:10:30 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-34312575-9f21-4b74-88bf-15eedc1f7731 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Created volume successfully. Sep 17 18:10:40 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:10:40 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:11:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:11:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:11:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:11:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:11:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:11:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:11:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:11:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.303s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:11:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:11:19 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Flow 'volume_create_manager' (cb06c37f-bd31-400f-8124-eb58e3cd607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b0f21a-9ae1-48d7-b95c-1a9843bfe22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b0f21a-9ae1-48d7-b95c-1a9843bfe22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1714107552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4095bd6-34fd-4204-853b-e163f2108a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b18f3783ee54cbca506fb546c4a4ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:11:19Z,use_quota=True,user_id='a5153bbf49de4739a6c659a7d6498517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6715b290-fd73-493b-8377-c5fb96f9a3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6715b290-fd73-493b-8377-c5fb96f9a3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4605230a-535e-4f8c-824f-5da3b9352c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4605230a-535e-4f8c-824f-5da3b9352c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4095bd6-34fd-4204-853b-e163f2108a22', 'volume_name': 'volume-f4095bd6-34fd-4204-853b-e163f2108a22', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1169451c-a100-4442-bfcd-5c6163447db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1169451c-a100-4442-bfcd-5c6163447db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc14b758-19e3-4c2f-a73a-93e5e78b9777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:11:19 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Volume f4095bd6-34fd-4204-853b-e163f2108a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4095bd6-34fd-4204-853b-e163f2108a22', 'volume_size': 1} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1714107552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4095bd6-34fd-4204-853b-e163f2108a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b18f3783ee54cbca506fb546c4a4ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:11:19Z,use_quota=True,user_id='a5153bbf49de4739a6c659a7d6498517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Creating volume f4095bd6-34fd-4204-853b-e163f2108a22 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:11:19 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:11:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4095bd6-34fd-4204-853b-e163f2108a22 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:11:20 devstack quobyte-client[83739]: System call of process 84687 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:11:20 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=4, name=volume-f4095bd6-34fd-4204-853b-e163f2108a22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:11:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4095bd6-34fd-4204-853b-e163f2108a22 1073741824" returned: 0 in 1.036s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:11:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4095bd6-34fd-4204-853b-e163f2108a22 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:11:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4095bd6-34fd-4204-853b-e163f2108a22" returned: 0 in 0.341s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:11:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] <== create_volume: return (1563ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:11:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:11:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc14b758-19e3-4c2f-a73a-93e5e78b9777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4095bd6-34fd-4204-853b-e163f2108a22', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:11:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f168d138-5fbb-4f02-a75c-82430854a707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:11:22 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Volume volume-f4095bd6-34fd-4204-853b-e163f2108a22 (f4095bd6-34fd-4204-853b-e163f2108a22): created successfully Sep 17 18:11:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f168d138-5fbb-4f02-a75c-82430854a707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:11:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Flow 'volume_create_manager' (cb06c37f-bd31-400f-8124-eb58e3cd607f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:11:22 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4630dff8-e229-4d6f-8c2d-221e4b5f1e2f tempest-VolumesAdminNegativeTest-907800150 None] Created volume successfully. Sep 17 18:11:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Acquiring lock "cinder-f4095bd6-34fd-4204-853b-e163f2108a22-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:11:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Lock "cinder-f4095bd6-34fd-4204-853b-e163f2108a22-delete_volume" acquired by "delete_volume" :: waited 0.198s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:11:24 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:11:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Acquiring lock "cinder-quobyte-f4095bd6-34fd-4204-853b-e163f2108a22" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:11:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Lock "cinder-quobyte-f4095bd6-34fd-4204-853b-e163f2108a22" acquired by "delete_volume" :: waited 0.048s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:11:25 devstack cinder-volume[83736]: INFO oslo.privsep.daemon [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn09b3a5s/privsep.sock'] Sep 17 18:11:25 devstack sudo[84705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn09b3a5s/privsep.sock Sep 17 18:11:25 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:11:34 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:11:34 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:11:44 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root Sep 17 18:11:45 devstack cinder-volume[83736]: INFO oslo.privsep.daemon [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Spawned new privsep daemon via rootwrap Sep 17 18:11:45 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Accepted privsep connection to /tmp/tmpn09b3a5s/privsep.sock {{(pid=83736) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 17 18:11:45 devstack cinder-volume[83736]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 17 18:11:45 devstack cinder-volume[83736]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 17 18:11:45 devstack cinder-volume[83736]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 17 18:11:45 devstack cinder-volume[83736]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84797 Sep 17 18:11:45 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59e7489-2820-49de-b730-79b2ba2bcd98]: (2,) {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:11:45 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aee5cbf-4680-46c2-b151-591c36ea9b48]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:11:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4095bd6-34fd-4204-853b-e163f2108a22 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:11:46 devstack quobyte-client[83739]: System call of process 84834 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:11:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4095bd6-34fd-4204-853b-e163f2108a22" returned: 0 in 1.724s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:11:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4095bd6-34fd-4204-853b-e163f2108a22 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:11:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4095bd6-34fd-4204-853b-e163f2108a22" returned: 0 in 0.212s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:11:47 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Lock "cinder-quobyte-f4095bd6-34fd-4204-853b-e163f2108a22" released by "delete_volume" :: held 22.934s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:11:48 devstack cinder-volume[83736]: WARNING cinder.quota [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:11:48 devstack cinder-volume[83736]: WARNING cinder.quota [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:11:48 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Created reservations ['398b98b7-a543-4dfe-a89f-03a8af30a085', '43043f6c-dadd-4d40-83c2-7e47f4c9a9f8', 'fe38d6ba-d983-48c5-8972-c72d8e8a0522', '9ae3960b-d60c-41e8-b6fc-0beb794abc78'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:11:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:11:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:11:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:11:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:11:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:11:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:11:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.272s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:11:49 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:11:50 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Deleted volume successfully. Sep 17 18:11:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4275d8a9-07ad-417b-9386-b848e6ce064d tempest-VolumesAdminNegativeTest-907800150 None] Lock "cinder-f4095bd6-34fd-4204-853b-e163f2108a22-delete_volume" released by "delete_volume" :: held 26.449s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:11:59 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:12:00 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:12:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:12:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:12:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:12:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:12:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:12:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:12:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:12:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.114s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:12:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:12:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-398e7509-0468-47ec-bca2-425b351ca2b5 req-e08f4a32-77ef-4814-8c2f-ca5150f31a89 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:12:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-398e7509-0468-47ec-bca2-425b351ca2b5 req-e08f4a32-77ef-4814-8c2f-ca5150f31a89 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:12:55 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cccad4-d9c6-4eb7-8941-04f3a837b127]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:12:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-398e7509-0468-47ec-bca2-425b351ca2b5 req-e08f4a32-77ef-4814-8c2f-ca5150f31a89 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:12:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-398e7509-0468-47ec-bca2-425b351ca2b5 req-e08f4a32-77ef-4814-8c2f-ca5150f31a89 tempest-VolumesAssistedSnapshotsTest-1362727782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311" returned: 0 in 0.640s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:12:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-398e7509-0468-47ec-bca2-425b351ca2b5 req-e08f4a32-77ef-4814-8c2f-ca5150f31a89 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.742s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:12:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-398e7509-0468-47ec-bca2-425b351ca2b5 req-e08f4a32-77ef-4814-8c2f-ca5150f31a89 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4820fe46-c067-4cdd-9bb0-51e09ba262a5', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:12:56 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-398e7509-0468-47ec-bca2-425b351ca2b5 req-e08f4a32-77ef-4814-8c2f-ca5150f31a89 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:12:56 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-398e7509-0468-47ec-bca2-425b351ca2b5 req-e08f4a32-77ef-4814-8c2f-ca5150f31a89 tempest-VolumesAssistedSnapshotsTest-1362727782 None] attachment_update completed successfully. Sep 17 18:12:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-e9786937-25f1-48ab-b22e-c29ab9e96440 req-193323f5-b62f-46a8-ba85-487e248c2e3d tempest-TaggedAttachmentsTest-1254444984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:12:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-e9786937-25f1-48ab-b22e-c29ab9e96440 req-193323f5-b62f-46a8-ba85-487e248c2e3d tempest-TaggedAttachmentsTest-1254444984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:12:57 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0309d5df-b565-4ef8-a645-2477dfc586f1]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:12:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-e9786937-25f1-48ab-b22e-c29ab9e96440 req-193323f5-b62f-46a8-ba85-487e248c2e3d tempest-TaggedAttachmentsTest-1254444984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77b64c80-fd78-471b-814b-47903de894e2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:12:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-e9786937-25f1-48ab-b22e-c29ab9e96440 req-193323f5-b62f-46a8-ba85-487e248c2e3d tempest-TaggedAttachmentsTest-1254444984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77b64c80-fd78-471b-814b-47903de894e2" returned: 0 in 0.860s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:12:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-e9786937-25f1-48ab-b22e-c29ab9e96440 req-193323f5-b62f-46a8-ba85-487e248c2e3d tempest-TaggedAttachmentsTest-1254444984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.956s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:12:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-e9786937-25f1-48ab-b22e-c29ab9e96440 req-193323f5-b62f-46a8-ba85-487e248c2e3d tempest-TaggedAttachmentsTest-1254444984 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-77b64c80-fd78-471b-814b-47903de894e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '820b3b90-75fb-41cf-b57f-05a2e74d7ac8', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:12:58 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-e9786937-25f1-48ab-b22e-c29ab9e96440 req-193323f5-b62f-46a8-ba85-487e248c2e3d tempest-TaggedAttachmentsTest-1254444984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:12:59 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-e9786937-25f1-48ab-b22e-c29ab9e96440 req-193323f5-b62f-46a8-ba85-487e248c2e3d tempest-TaggedAttachmentsTest-1254444984 None] attachment_update completed successfully. Sep 17 18:13:09 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:13:09 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:13:10 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Flow 'volume_create_manager' (75277abb-2cc9-42da-bc5c-b39c9f85f9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14354363-1e54-4cf6-8501-8b2cf2f85e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14354363-1e54-4cf6-8501-8b2cf2f85e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1194637980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099f93cc-dc60-45d6-9545-b403bd072c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b749962e06e44f1dbd48f81a40ef3b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:13:10Z,use_quota=True,user_id='b3fc0e4225d047eeaefddf1b6ac1ede3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50e7f0e-2b49-4791-8138-f3362c068122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50e7f0e-2b49-4791-8138-f3362c068122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2758242-672c-4d3f-8afa-ba21c07905d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2758242-672c-4d3f-8afa-ba21c07905d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '099f93cc-dc60-45d6-9545-b403bd072c19', 'volume_name': 'volume-099f93cc-dc60-45d6-9545-b403bd072c19', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d78273-67ed-4c95-88f2-e990e8bb349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d78273-67ed-4c95-88f2-e990e8bb349a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900a504c-14d3-4c9c-9f8d-e4e256a94d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:13:10 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Volume 099f93cc-dc60-45d6-9545-b403bd072c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-099f93cc-dc60-45d6-9545-b403bd072c19', 'volume_size': 1} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1194637980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099f93cc-dc60-45d6-9545-b403bd072c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b749962e06e44f1dbd48f81a40ef3b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:13:10Z,use_quota=True,user_id='b3fc0e4225d047eeaefddf1b6ac1ede3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Creating volume 099f93cc-dc60-45d6-9545-b403bd072c19 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:13:10 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-099f93cc-dc60-45d6-9545-b403bd072c19 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:13:10 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=5, name=volume-099f93cc-dc60-45d6-9545-b403bd072c19, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:13:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-099f93cc-dc60-45d6-9545-b403bd072c19 1073741824" returned: 0 in 0.416s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:13:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-099f93cc-dc60-45d6-9545-b403bd072c19 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:13:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-099f93cc-dc60-45d6-9545-b403bd072c19" returned: 0 in 0.177s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:13:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] <== create_volume: return (696ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:13:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:13:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900a504c-14d3-4c9c-9f8d-e4e256a94d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-099f93cc-dc60-45d6-9545-b403bd072c19', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:13:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371f9ff4-494f-4a09-a2ab-eb9de9a3f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:13:11 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Volume volume-099f93cc-dc60-45d6-9545-b403bd072c19 (099f93cc-dc60-45d6-9545-b403bd072c19): created successfully Sep 17 18:13:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371f9ff4-494f-4a09-a2ab-eb9de9a3f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:13:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Flow 'volume_create_manager' (75277abb-2cc9-42da-bc5c-b39c9f85f9e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:13:11 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-177f470c-b284-4c90-91d2-ac2ad3187966 tempest-DeleteServersTestJSON-1617157326 None] Created volume successfully. Sep 17 18:13:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-0ca547de-1ba7-4e71-b423-ff242cdd46a6 req-5044e8a9-cd4c-48e7-88da-289442fea56c tempest-DeleteServersTestJSON-1617157326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:13:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-0ca547de-1ba7-4e71-b423-ff242cdd46a6 req-5044e8a9-cd4c-48e7-88da-289442fea56c tempest-DeleteServersTestJSON-1617157326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:13:16 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[183eab74-9625-4f00-8f14-49bb358abcd9]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:13:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-0ca547de-1ba7-4e71-b423-ff242cdd46a6 req-5044e8a9-cd4c-48e7-88da-289442fea56c tempest-DeleteServersTestJSON-1617157326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-099f93cc-dc60-45d6-9545-b403bd072c19 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:13:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-0ca547de-1ba7-4e71-b423-ff242cdd46a6 req-5044e8a9-cd4c-48e7-88da-289442fea56c tempest-DeleteServersTestJSON-1617157326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-099f93cc-dc60-45d6-9545-b403bd072c19" returned: 0 in 0.385s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:13:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-0ca547de-1ba7-4e71-b423-ff242cdd46a6 req-5044e8a9-cd4c-48e7-88da-289442fea56c tempest-DeleteServersTestJSON-1617157326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.432s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:13:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-0ca547de-1ba7-4e71-b423-ff242cdd46a6 req-5044e8a9-cd4c-48e7-88da-289442fea56c tempest-DeleteServersTestJSON-1617157326 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-099f93cc-dc60-45d6-9545-b403bd072c19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a88b897e-4966-44f2-b596-ac4ad4adfbb4', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:13:16 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-0ca547de-1ba7-4e71-b423-ff242cdd46a6 req-5044e8a9-cd4c-48e7-88da-289442fea56c tempest-DeleteServersTestJSON-1617157326 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:13:16 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-0ca547de-1ba7-4e71-b423-ff242cdd46a6 req-5044e8a9-cd4c-48e7-88da-289442fea56c tempest-DeleteServersTestJSON-1617157326 None] attachment_update completed successfully. Sep 17 18:13:26 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:13:27 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:13:27 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-8cd4ea01-a079-484b-9eee-6bb6592ff40e req-95de5a10-b0cf-45e6-adb5-94d524f2782e tempest-DeleteServersTestJSON-1617157326 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:13:27 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-8cd4ea01-a079-484b-9eee-6bb6592ff40e req-95de5a10-b0cf-45e6-adb5-94d524f2782e tempest-DeleteServersTestJSON-1617157326 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:13:27 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-8cd4ea01-a079-484b-9eee-6bb6592ff40e req-95de5a10-b0cf-45e6-adb5-94d524f2782e tempest-DeleteServersTestJSON-1617157326 None] Terminate volume connection completed successfully. Sep 17 18:13:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-8cd4ea01-a079-484b-9eee-6bb6592ff40e req-95de5a10-b0cf-45e6-adb5-94d524f2782e tempest-DeleteServersTestJSON-1617157326 None] Deleting attachment a88b897e-4966-44f2-b596-ac4ad4adfbb4. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:13:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-348b353f-57cc-48ce-8bc2-563bf3d7d9cb req-ccfcd3c3-b252-43e1-88f2-60973b67a8f3 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:13:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-348b353f-57cc-48ce-8bc2-563bf3d7d9cb req-ccfcd3c3-b252-43e1-88f2-60973b67a8f3 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:13:28 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-348b353f-57cc-48ce-8bc2-563bf3d7d9cb req-ccfcd3c3-b252-43e1-88f2-60973b67a8f3 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Terminate volume connection completed successfully. Sep 17 18:13:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-348b353f-57cc-48ce-8bc2-563bf3d7d9cb req-ccfcd3c3-b252-43e1-88f2-60973b67a8f3 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Deleting attachment 4820fe46-c067-4cdd-9bb0-51e09ba262a5. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:13:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Acquiring lock "cinder-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:13:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "cinder-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:13:30 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:13:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Acquiring lock "cinder-quobyte-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:13:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "cinder-quobyte-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:13:30 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb17f8d-8cbf-4bcc-8888-344ed059d0f5]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:13:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311" returned: 0 in 0.387s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311" returned: 0 in 0.091s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "cinder-quobyte-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311" released by "delete_volume" :: held 0.629s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:13:31 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-3523d879-ac80-41fe-8bcd-c64ac47617a3 req-1cd921a7-c9e8-4962-acd6-f4c272b12bfe tempest-TaggedAttachmentsTest-1254444984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:13:31 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-3523d879-ac80-41fe-8bcd-c64ac47617a3 req-1cd921a7-c9e8-4962-acd6-f4c272b12bfe tempest-TaggedAttachmentsTest-1254444984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:13:31 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-3523d879-ac80-41fe-8bcd-c64ac47617a3 req-1cd921a7-c9e8-4962-acd6-f4c272b12bfe tempest-TaggedAttachmentsTest-1254444984 None] Terminate volume connection completed successfully. Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-3523d879-ac80-41fe-8bcd-c64ac47617a3 req-1cd921a7-c9e8-4962-acd6-f4c272b12bfe tempest-TaggedAttachmentsTest-1254444984 None] Deleting attachment 820b3b90-75fb-41cf-b57f-05a2e74d7ac8. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Acquiring lock "cinder-099f93cc-dc60-45d6-9545-b403bd072c19-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Lock "cinder-099f93cc-dc60-45d6-9545-b403bd072c19-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Created reservations ['a54628a3-10d6-45ef-adcf-08c88f793196', '00144693-9e3a-45b5-ad2c-066d7f573041', '43d4b46b-1eae-45aa-81cf-ab0c19a8a368', '2dc6dd31-43a6-43a1-a8a2-4641a31d23f1'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:13:31 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Acquiring lock "cinder-quobyte-099f93cc-dc60-45d6-9545-b403bd072c19" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Lock "cinder-quobyte-099f93cc-dc60-45d6-9545-b403bd072c19" acquired by "delete_volume" :: waited 0.026s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[da285a6b-b07d-4126-bbeb-04081d54ffc7]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:13:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-099f93cc-dc60-45d6-9545-b403bd072c19 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.081s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:13:32 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Deleted volume successfully. Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-099f93cc-dc60-45d6-9545-b403bd072c19" returned: 0 in 0.650s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-099f93cc-dc60-45d6-9545-b403bd072c19 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-099f93cc-dc60-45d6-9545-b403bd072c19" returned: 0 in 0.176s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-da00d292-3635-48a2-bd98-1c132dff9537 tempest-VolumesAssistedSnapshotsTest-1362727782 None] Lock "cinder-c0aa0e0f-1ac8-4bf5-92bd-ede0cfc9c311-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:13:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Lock "cinder-quobyte-099f93cc-dc60-45d6-9545-b403bd072c19" released by "delete_volume" :: held 0.938s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:13:33 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Created reservations ['eb3a957c-ed3b-4306-a357-78bb7f780b91', 'adcf6bac-b8c8-4c0a-9d89-93aa87d8219c', 'b762b6f2-f459-4110-8cc3-0a3434ae2b3a', '60e0306c-500c-486a-9cd6-10078b5191f2'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:13:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:13:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:13:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:13:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:13:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:13:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:13:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.086s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:13:33 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:13:33 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Deleted volume successfully. Sep 17 18:13:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fad042a6-0d88-4b97-88a9-e814f4fc5bab tempest-DeleteServersTestJSON-1617157326 None] Lock "cinder-099f93cc-dc60-45d6-9545-b403bd072c19-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:13:43 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=12,cinder:UPDATE=20,cinder:INSERT=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:13:43 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:14:15 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:14:15 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:14:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Flow 'volume_create_manager' (b2dbfb7e-00d3-4fc4-bcca-4d45499b7a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:14:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98ad3e1-4b3f-4af9-a5d3-673fe34cca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98ad3e1-4b3f-4af9-a5d3-673fe34cca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1049976811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77153374-e591-4dde-88d6-dd724b5661cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ebbae989134beb99be0762105a3a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:14:16Z,use_quota=True,user_id='cc59669633554b9b8c9bfdd67de2675e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152bbdad-3e8a-4f19-9fde-342ba93494e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152bbdad-3e8a-4f19-9fde-342ba93494e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1c26e6-d17a-4cd0-96ab-e1d293c0429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG cinder.image.glance [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Creating Keystone auth plugin from conf {{(pid=83736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.177s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:14:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1c26e6-d17a-4cd0-96ab-e1d293c0429f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77153374-e591-4dde-88d6-dd724b5661cf', 'volume_name': 'volume-77153374-e591-4dde-88d6-dd724b5661cf', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854d3319-bf53-4f31-a5b1-2c43697166ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854d3319-bf53-4f31-a5b1-2c43697166ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec8718a-59e1-43ce-9d7f-7ce7f7516eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:17 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Volume 77153374-e591-4dde-88d6-dd724b5661cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77153374-e591-4dde-88d6-dd724b5661cf', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 18:14:17 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Cloning 77153374-e591-4dde-88d6-dd724b5661cf from image 9006947d-67cc-459e-820f-320733203bdb at location (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]). {{(pid=83736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 17 18:14:17 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 18:14:17 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Image download 20.69 MB at 20.69 MB/s Sep 17 18:14:17 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08fba0e-99a9-4e9f-a3c3-b897e1c14574]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:14:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:18 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD Sep 17 18:14:18 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:14:20 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Sep 17 18:14:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD" returned: 0 in 3.282s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:20 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Temporary image 9006947d-67cc-459e-820f-320733203bdb is fetched for user cc59669633554b9b8c9bfdd67de2675e. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 18:14:21 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed78ea89-5c50-4c36-9233-61648e2b321a]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:14:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:21 devstack sudo[85959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD Sep 17 18:14:21 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:14:23 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD" returned: 0 in 2.389s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1049976811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77153374-e591-4dde-88d6-dd724b5661cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ebbae989134beb99be0762105a3a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:14:16Z,use_quota=True,user_id='cc59669633554b9b8c9bfdd67de2675e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Creating volume 77153374-e591-4dde-88d6-dd724b5661cf {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:14:23 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:14:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:24 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=6, name=volume-77153374-e591-4dde-88d6-dd724b5661cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:14:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf 1073741824" returned: 0 in 0.397s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf" returned: 0 in 0.138s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] <== create_volume: return (673ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:14:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:14:24 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Attempting download of 9006947d-67cc-459e-820f-320733203bdb ((None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}])) to volume 77153374-e591-4dde-88d6-dd724b5661cf. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 18:14:25 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaffeefc-ba14-481d-874c-5ad7c309de28]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:14:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_jliyajrk {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Acquiring lock "cinder-77b64c80-fd78-471b-814b-47903de894e2-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:14:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_jliyajrk" returned: 0 in 0.663s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_jliyajrk {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Lock "cinder-77b64c80-fd78-471b-814b-47903de894e2-delete_volume" acquired by "delete_volume" :: waited 0.177s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:14:26 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:14:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Acquiring lock "cinder-quobyte-77b64c80-fd78-471b-814b-47903de894e2" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:14:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Lock "cinder-quobyte-77b64c80-fd78-471b-814b-47903de894e2" acquired by "delete_volume" :: waited 0.027s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:14:26 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[811d0b6f-fb93-4134-a34b-d0ea56c0bebd]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:14:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77b64c80-fd78-471b-814b-47903de894e2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_jliyajrk" returned: 1 in 0.621s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_jliyajrk' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:14:26 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a23f2fe-4e24-4445-95d8-7a55bdb72cd8]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:14:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:26 devstack quobyte-client[83739]: System call of process 85972 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:14:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77b64c80-fd78-471b-814b-47903de894e2" returned: 0 in 0.543s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77b64c80-fd78-471b-814b-47903de894e2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77b64c80-fd78-471b-814b-47903de894e2" returned: 0 in 0.172s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Lock "cinder-quobyte-77b64c80-fd78-471b-814b-47903de894e2" released by "delete_volume" :: held 1.004s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:14:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD" returned: 0 in 1.018s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:27 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] 9006947d-67cc-459e-820f-320733203bdb was qcow2, converting to raw {{(pid=83736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 18:14:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:27 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=6, name=volume-77153374-e591-4dde-88d6-dd724b5661cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:14:27 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Created reservations ['d41c4c6a-969f-49dd-8650-a0559eab67c6', 'be0c4b72-33f3-4b60-b22c-7947be88c34a', '08bcf8b6-b3b1-49ec-810d-5e38009c303c', '4e5f51d1-996c-4590-a35b-a156e4b4feb5'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.145s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:14:28 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Deleted volume successfully. Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8c59d843-d391-4a78-98f9-036d414b1e45 tempest-TaggedAttachmentsTest-1254444984 None] Lock "cinder-77b64c80-fd78-471b-814b-47903de894e2-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf" returned: 0 in 1.362s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_0g9z8rtrdevstack@QuobyteHD, size 112.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:14:28 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Converted 112.00 MB image at 82.02 MB/s Sep 17 18:14:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf 1G" returned: 0 in 0.199s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:29 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dae75d9-1313-4822-879a-b941c08941db]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:14:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf" returned: 0 in 0.475s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf" returned: 1 in 0.538s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:14:30 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Downloaded image 9006947d-67cc-459e-820f-320733203bdb ((None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}])) to volume 77153374-e591-4dde-88d6-dd724b5661cf successfully. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 18:14:30 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Temporary image 9006947d-67cc-459e-820f-320733203bdb for user cc59669633554b9b8c9bfdd67de2675e is deleted. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 18:14:30 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Marking volume 77153374-e591-4dde-88d6-dd724b5661cf as bootable. {{(pid=83736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 18:14:31 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Copying metadata from image 9006947d-67cc-459e-820f-320733203bdb to 77153374-e591-4dde-88d6-dd724b5661cf. {{(pid=83736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 18:14:31 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Creating volume glance metadata for volume 77153374-e591-4dde-88d6-dd724b5661cf backed by image 9006947d-67cc-459e-820f-320733203bdb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 18:14:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec8718a-59e1-43ce-9d7f-7ce7f7516eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77153374-e591-4dde-88d6-dd724b5661cf', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c49afc-eb58-44d9-91ca-ee9c3ab2a636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:31 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Volume volume-77153374-e591-4dde-88d6-dd724b5661cf (77153374-e591-4dde-88d6-dd724b5661cf): created successfully Sep 17 18:14:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c49afc-eb58-44d9-91ca-ee9c3ab2a636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Flow 'volume_create_manager' (b2dbfb7e-00d3-4fc4-bcca-4d45499b7a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:14:31 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-837da8ed-c74d-4532-aab6-4119848fe57b tempest-TaggedBootDevicesTest-1597936544 None] Created volume successfully. Sep 17 18:14:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Flow 'volume_create_manager' (8d242b7c-511c-402e-bf02-3f7c18f9d9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b441d6-4f20-449d-8913-a604f2ee8ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b441d6-4f20-449d-8913-a604f2ee8ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-51168742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0380a8-e228-4643-9263-6bc3d4b001a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ebbae989134beb99be0762105a3a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:14:33Z,use_quota=True,user_id='cc59669633554b9b8c9bfdd67de2675e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8c7188-ced7-4837-9388-b8718bb55a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8c7188-ced7-4837-9388-b8718bb55a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d6378d-f4aa-49e6-88b9-fe4748da250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d6378d-f4aa-49e6-88b9-fe4748da250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0380a8-e228-4643-9263-6bc3d4b001a7', 'volume_name': 'volume-ee0380a8-e228-4643-9263-6bc3d4b001a7', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9204aae3-2337-4181-a43c-cfeea90aeaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9204aae3-2337-4181-a43c-cfeea90aeaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589e77a1-e216-43e2-8f0b-13b69b58e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:33 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Volume ee0380a8-e228-4643-9263-6bc3d4b001a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0380a8-e228-4643-9263-6bc3d4b001a7', 'volume_size': 1} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-51168742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0380a8-e228-4643-9263-6bc3d4b001a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ebbae989134beb99be0762105a3a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:14:33Z,use_quota=True,user_id='cc59669633554b9b8c9bfdd67de2675e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Creating volume ee0380a8-e228-4643-9263-6bc3d4b001a7 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:14:33 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:14:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-ee0380a8-e228-4643-9263-6bc3d4b001a7 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:33 devstack quobyte-client[83739]: System call of process 86030 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:14:33 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=7, name=volume-ee0380a8-e228-4643-9263-6bc3d4b001a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:14:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-ee0380a8-e228-4643-9263-6bc3d4b001a7 1073741824" returned: 0 in 0.715s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-ee0380a8-e228-4643-9263-6bc3d4b001a7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-ee0380a8-e228-4643-9263-6bc3d4b001a7" returned: 0 in 0.170s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] <== create_volume: return (1074ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:14:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:14:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589e77a1-e216-43e2-8f0b-13b69b58e359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0380a8-e228-4643-9263-6bc3d4b001a7', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbd09f5-0200-4ccb-8840-92a2456808c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:34 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Volume volume-ee0380a8-e228-4643-9263-6bc3d4b001a7 (ee0380a8-e228-4643-9263-6bc3d4b001a7): created successfully Sep 17 18:14:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbd09f5-0200-4ccb-8840-92a2456808c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Flow 'volume_create_manager' (8d242b7c-511c-402e-bf02-3f7c18f9d9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:14:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-543ee572-2c85-4ca9-8579-2c3ba0162ee5 tempest-TaggedBootDevicesTest-1597936544 None] Created volume successfully. Sep 17 18:14:36 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Flow 'volume_create_manager' (3e984d6d-9938-4fed-b0fd-eb058030aecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8615fc-5e08-477c-88fa-c4114a83c331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8615fc-5e08-477c-88fa-c4114a83c331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2099457630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663db78a-43f3-4053-be9b-6c74afde2391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ebbae989134beb99be0762105a3a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:14:37Z,use_quota=True,user_id='cc59669633554b9b8c9bfdd67de2675e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c4e35e-035d-4657-a120-5a5bec472940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c4e35e-035d-4657-a120-5a5bec472940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011f79c4-eb25-4ee3-9a17-956c1c767489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011f79c4-eb25-4ee3-9a17-956c1c767489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663db78a-43f3-4053-be9b-6c74afde2391', 'volume_name': 'volume-663db78a-43f3-4053-be9b-6c74afde2391', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ad16d1-f533-4057-be3b-dd6a1ccc9de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ad16d1-f533-4057-be3b-dd6a1ccc9de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148c6ff6-c5a4-49f4-af4e-58b19d00e4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:36 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Volume 663db78a-43f3-4053-be9b-6c74afde2391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663db78a-43f3-4053-be9b-6c74afde2391', 'volume_size': 1} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2099457630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663db78a-43f3-4053-be9b-6c74afde2391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ebbae989134beb99be0762105a3a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:14:37Z,use_quota=True,user_id='cc59669633554b9b8c9bfdd67de2675e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Creating volume 663db78a-43f3-4053-be9b-6c74afde2391 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:14:36 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:14:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-663db78a-43f3-4053-be9b-6c74afde2391 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:37 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=8, name=volume-663db78a-43f3-4053-be9b-6c74afde2391, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:14:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-663db78a-43f3-4053-be9b-6c74afde2391 1073741824" returned: 0 in 0.420s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-663db78a-43f3-4053-be9b-6c74afde2391 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:14:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-663db78a-43f3-4053-be9b-6c74afde2391" returned: 0 in 0.178s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:14:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] <== create_volume: return (686ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:14:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:14:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148c6ff6-c5a4-49f4-af4e-58b19d00e4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663db78a-43f3-4053-be9b-6c74afde2391', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78059235-4287-4ee0-a434-8ffe45a50589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:14:37 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Volume volume-663db78a-43f3-4053-be9b-6c74afde2391 (663db78a-43f3-4053-be9b-6c74afde2391): created successfully Sep 17 18:14:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78059235-4287-4ee0-a434-8ffe45a50589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:14:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Flow 'volume_create_manager' (3e984d6d-9938-4fed-b0fd-eb058030aecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:14:38 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d5308f7d-bfee-477c-8c7e-7234d66221a6 tempest-TaggedBootDevicesTest-1597936544 None] Created volume successfully. Sep 17 18:14:46 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=19,cinder:SELECT=13,cinder:INSERT=5,cinder:DELETE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:14:48 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=18,cinder:INSERT=12,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:15:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-d6731fc7-22da-412f-a487-97e809b940e9 tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:15:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-d6731fc7-22da-412f-a487-97e809b940e9 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:15:15 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cae409-6998-4ea0-8f0a-d53ba9903764]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:15:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-d6731fc7-22da-412f-a487-97e809b940e9 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:15:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-d6731fc7-22da-412f-a487-97e809b940e9 tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf" returned: 0 in 0.513s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:15:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-d6731fc7-22da-412f-a487-97e809b940e9 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-d6731fc7-22da-412f-a487-97e809b940e9 tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf" returned: 1 in 0.856s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-d6731fc7-22da-412f-a487-97e809b940e9 tempest-TaggedBootDevicesTest-1597936544 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-d6731fc7-22da-412f-a487-97e809b940e9 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.566s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.320s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:15:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:15:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-d6731fc7-22da-412f-a487-97e809b940e9 tempest-TaggedBootDevicesTest-1597936544 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-77153374-e591-4dde-88d6-dd724b5661cf', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21d972f3-439d-4892-baa2-612183a8b327', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:15:17 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-d6731fc7-22da-412f-a487-97e809b940e9 tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:15:17 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-d6731fc7-22da-412f-a487-97e809b940e9 tempest-TaggedBootDevicesTest-1597936544 None] attachment_update completed successfully. Sep 17 18:15:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-ba718f49-2e8d-4f35-a66f-877a3da0e6f2 tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:15:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-ba718f49-2e8d-4f35-a66f-877a3da0e6f2 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:15:25 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2407c7ac-7d13-4190-bc02-f1d2f3a1c2d7]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:15:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-ba718f49-2e8d-4f35-a66f-877a3da0e6f2 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-ee0380a8-e228-4643-9263-6bc3d4b001a7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:15:26 devstack quobyte-client[83739]: System call of process 86168 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:15:26 devstack quobyte-client[83739]: System call of process 86168 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:15:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-ba718f49-2e8d-4f35-a66f-877a3da0e6f2 tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-ee0380a8-e228-4643-9263-6bc3d4b001a7" returned: 0 in 1.338s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:15:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-ba718f49-2e8d-4f35-a66f-877a3da0e6f2 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.427s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:15:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-ba718f49-2e8d-4f35-a66f-877a3da0e6f2 tempest-TaggedBootDevicesTest-1597936544 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-ee0380a8-e228-4643-9263-6bc3d4b001a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce7335d1-5503-47df-8294-4f008c7d3547', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:15:27 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-ba718f49-2e8d-4f35-a66f-877a3da0e6f2 tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:15:27 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-ba718f49-2e8d-4f35-a66f-877a3da0e6f2 tempest-TaggedBootDevicesTest-1597936544 None] attachment_update completed successfully. Sep 17 18:15:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-860b98dd-0a02-4cb5-99fb-5df8a8604ef4 tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:15:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-860b98dd-0a02-4cb5-99fb-5df8a8604ef4 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.019s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:15:32 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a978b47-9f73-42a3-bb4e-092185d3d6c4]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:15:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-860b98dd-0a02-4cb5-99fb-5df8a8604ef4 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-663db78a-43f3-4053-be9b-6c74afde2391 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:15:34 devstack quobyte-client[83739]: System call of process 86270 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:15:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-860b98dd-0a02-4cb5-99fb-5df8a8604ef4 tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-663db78a-43f3-4053-be9b-6c74afde2391" returned: 0 in 1.909s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:15:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-860b98dd-0a02-4cb5-99fb-5df8a8604ef4 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.183s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:15:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-860b98dd-0a02-4cb5-99fb-5df8a8604ef4 tempest-TaggedBootDevicesTest-1597936544 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-663db78a-43f3-4053-be9b-6c74afde2391', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a559922-3848-4b7a-929f-c47015efc9d3', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:15:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-860b98dd-0a02-4cb5-99fb-5df8a8604ef4 tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:15:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-2dc25a9a-a1f3-4680-a00e-6618273f2186 req-860b98dd-0a02-4cb5-99fb-5df8a8604ef4 tempest-TaggedBootDevicesTest-1597936544 None] attachment_update completed successfully. Sep 17 18:15:47 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:15:47 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:16:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:16:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:16:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:16:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:16:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:16:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:16:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:16:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.461s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:16:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:16:57 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Flow 'volume_create_manager' (ef758ad8-1002-41de-a486-8c2d65bc4cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd42f64-d9fc-4e4a-a4c8-2e2264b1cd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd42f64-d9fc-4e4a-a4c8-2e2264b1cd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-789069725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de048742-7d5f-4524-9aaf-1af80cebbc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a7b51491394391811bbd62923ccd6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:16:56Z,use_quota=True,user_id='3783dc563bdb496c92db5a49b661289b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2889ba7a-1d37-4cc5-a280-2ba11c86a01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2889ba7a-1d37-4cc5-a280-2ba11c86a01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c5cd7d-e5a1-4403-a1ec-f69118ac4aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c5cd7d-e5a1-4403-a1ec-f69118ac4aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de048742-7d5f-4524-9aaf-1af80cebbc92', 'volume_name': 'volume-de048742-7d5f-4524-9aaf-1af80cebbc92', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88ec5f0-ba2b-453b-86ea-a095bf104466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88ec5f0-ba2b-453b-86ea-a095bf104466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b4a24f-1ea0-49a8-8b96-fbd038446ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:16:57 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Volume de048742-7d5f-4524-9aaf-1af80cebbc92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de048742-7d5f-4524-9aaf-1af80cebbc92', 'volume_size': 1} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-789069725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de048742-7d5f-4524-9aaf-1af80cebbc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a7b51491394391811bbd62923ccd6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:16:56Z,use_quota=True,user_id='3783dc563bdb496c92db5a49b661289b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Creating volume de048742-7d5f-4524-9aaf-1af80cebbc92 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:16:57 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:16:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-de048742-7d5f-4524-9aaf-1af80cebbc92 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:16:58 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=9, name=volume-de048742-7d5f-4524-9aaf-1af80cebbc92, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:16:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-de048742-7d5f-4524-9aaf-1af80cebbc92 1073741824" returned: 0 in 1.376s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:16:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-de048742-7d5f-4524-9aaf-1af80cebbc92 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:16:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-de048742-7d5f-4524-9aaf-1af80cebbc92" returned: 0 in 0.260s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:16:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] <== create_volume: return (1935ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:16:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:17:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b4a24f-1ea0-49a8-8b96-fbd038446ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de048742-7d5f-4524-9aaf-1af80cebbc92', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a806337-4f3b-4bbc-9947-2fc571cd4369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:01 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Volume volume-de048742-7d5f-4524-9aaf-1af80cebbc92 (de048742-7d5f-4524-9aaf-1af80cebbc92): created successfully Sep 17 18:17:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a806337-4f3b-4bbc-9947-2fc571cd4369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Flow 'volume_create_manager' (ef758ad8-1002-41de-a486-8c2d65bc4cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:17:01 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c0af5106-6217-4b51-a8e4-73ebec148684 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Created volume successfully. Sep 17 18:17:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-0e0b43db-c159-4eee-865b-ed9296b044b1 req-541695f8-3849-4a26-8d36-10c0a49c510d tempest-AttachSCSIVolumeTestJSON-1546384124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:17:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-0e0b43db-c159-4eee-865b-ed9296b044b1 req-541695f8-3849-4a26-8d36-10c0a49c510d tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.024s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:17:10 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[961d2abf-c97e-4a3e-a3ca-92ae69564900]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:17:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-0e0b43db-c159-4eee-865b-ed9296b044b1 req-541695f8-3849-4a26-8d36-10c0a49c510d tempest-AttachSCSIVolumeTestJSON-1546384124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-de048742-7d5f-4524-9aaf-1af80cebbc92 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:12 devstack quobyte-client[83739]: System call of process 87616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:17:12 devstack quobyte-client[83739]: System call of process 87616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:17:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-0e0b43db-c159-4eee-865b-ed9296b044b1 req-541695f8-3849-4a26-8d36-10c0a49c510d tempest-AttachSCSIVolumeTestJSON-1546384124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-de048742-7d5f-4524-9aaf-1af80cebbc92" returned: 0 in 2.208s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-0e0b43db-c159-4eee-865b-ed9296b044b1 req-541695f8-3849-4a26-8d36-10c0a49c510d tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.400s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:17:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-0e0b43db-c159-4eee-865b-ed9296b044b1 req-541695f8-3849-4a26-8d36-10c0a49c510d tempest-AttachSCSIVolumeTestJSON-1546384124 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-de048742-7d5f-4524-9aaf-1af80cebbc92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22350b25-cfbf-4eb4-a079-26dcad040f1d', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:17:13 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-0e0b43db-c159-4eee-865b-ed9296b044b1 req-541695f8-3849-4a26-8d36-10c0a49c510d tempest-AttachSCSIVolumeTestJSON-1546384124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:17:13 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-0e0b43db-c159-4eee-865b-ed9296b044b1 req-541695f8-3849-4a26-8d36-10c0a49c510d tempest-AttachSCSIVolumeTestJSON-1546384124 None] attachment_update completed successfully. Sep 17 18:17:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:17:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:17:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:17:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:17:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:17:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:17:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.269s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:17:17 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:17:17 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:17:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Flow 'volume_create_manager' (5b33fb04-8991-4f98-a78b-867c243c807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:17:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222e2844-06bf-4ba1-bfc9-f1bdc592d81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222e2844-06bf-4ba1-bfc9-f1bdc592d81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1282233275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f33f01bca3ce4b0e84a1d34abb16d603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:17:17Z,use_quota=True,user_id='9de8667bf70444429a1159b307489729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c673bef-6c51-4dd1-a3a9-06f4f5bcc3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c673bef-6c51-4dd1-a3a9-06f4f5bcc3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f0e050-2ad1-4b0b-b236-e76a1c380d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:17 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f0e050-2ad1-4b0b-b236-e76a1c380d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc', 'volume_name': 'volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcf5b7e-d465-4688-a147-f3b114a0d1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcf5b7e-d465-4688-a147-f3b114a0d1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66da7407-7d71-4e9f-bba7-46613142fbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:18 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Volume f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc', 'volume_size': 1} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1282233275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f33f01bca3ce4b0e84a1d34abb16d603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:17:17Z,use_quota=True,user_id='9de8667bf70444429a1159b307489729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Creating volume f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:17:18 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:17:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:18 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=10, name=volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:17:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc 1073741824" returned: 0 in 0.976s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc" returned: 0 in 0.204s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] <== create_volume: return (1274ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:17:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:17:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66da7407-7d71-4e9f-bba7-46613142fbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67c8075-59ce-4dc2-9d3d-46088b994baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:19 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Volume volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc (f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc): created successfully Sep 17 18:17:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67c8075-59ce-4dc2-9d3d-46088b994baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Flow 'volume_create_manager' (5b33fb04-8991-4f98-a78b-867c243c807d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:17:20 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-91bf4fd7-6e23-4828-9ded-9a3ca1f8dfb6 tempest-ServersNegativeTestJSON-596854249 None] Created volume successfully. Sep 17 18:17:23 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Flow 'volume_create_manager' (c15685f3-68e7-4474-8d38-06086cb8fdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946f6979-4cfc-40f8-85ed-18ce7fe8c824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946f6979-4cfc-40f8-85ed-18ce7fe8c824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1593962941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf4a937-768b-4e9a-831a-6002defeab52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f33f01bca3ce4b0e84a1d34abb16d603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:17:23Z,use_quota=True,user_id='9de8667bf70444429a1159b307489729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14348498-33e8-42f9-b73e-0dfad63c15db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14348498-33e8-42f9-b73e-0dfad63c15db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c311460a-27c3-4140-8d44-18db1864140b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c311460a-27c3-4140-8d44-18db1864140b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf4a937-768b-4e9a-831a-6002defeab52', 'volume_name': 'volume-bcf4a937-768b-4e9a-831a-6002defeab52', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176c403a-defc-48ff-891e-882e1db7c380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176c403a-defc-48ff-891e-882e1db7c380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6bf615-16c3-4a38-8c00-0fd28877626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:23 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Volume bcf4a937-768b-4e9a-831a-6002defeab52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf4a937-768b-4e9a-831a-6002defeab52', 'volume_size': 1} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1593962941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf4a937-768b-4e9a-831a-6002defeab52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f33f01bca3ce4b0e84a1d34abb16d603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:17:23Z,use_quota=True,user_id='9de8667bf70444429a1159b307489729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Creating volume bcf4a937-768b-4e9a-831a-6002defeab52 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:17:23 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-bcf4a937-768b-4e9a-831a-6002defeab52 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:23 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=11, name=volume-bcf4a937-768b-4e9a-831a-6002defeab52, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-bcf4a937-768b-4e9a-831a-6002defeab52 1073741824" returned: 0 in 0.325s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-bcf4a937-768b-4e9a-831a-6002defeab52 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-bcf4a937-768b-4e9a-831a-6002defeab52" returned: 0 in 0.085s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] <== create_volume: return (475ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:17:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.488s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:17:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6bf615-16c3-4a38-8c00-0fd28877626d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf4a937-768b-4e9a-831a-6002defeab52', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3024a78b-5ac8-402d-bac7-a58686da40b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:17:24 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Volume volume-bcf4a937-768b-4e9a-831a-6002defeab52 (bcf4a937-768b-4e9a-831a-6002defeab52): created successfully Sep 17 18:17:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3024a78b-5ac8-402d-bac7-a58686da40b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:17:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Flow 'volume_create_manager' (c15685f3-68e7-4474-8d38-06086cb8fdf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:17:24 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-815386cb-dde0-4b30-b8d4-c75613a230b3 tempest-ServersNegativeTestJSON-596854249 None] Created volume successfully. Sep 17 18:17:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Acquiring lock "cinder-bcf4a937-768b-4e9a-831a-6002defeab52-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:17:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Lock "cinder-bcf4a937-768b-4e9a-831a-6002defeab52-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:17:26 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:17:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Acquiring lock "cinder-quobyte-bcf4a937-768b-4e9a-831a-6002defeab52" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:17:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Lock "cinder-quobyte-bcf4a937-768b-4e9a-831a-6002defeab52" acquired by "delete_volume" :: waited 0.044s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:17:26 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5777d61-e8db-44ac-9d3b-79df95ebec5f]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:17:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-bcf4a937-768b-4e9a-831a-6002defeab52 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-bcf4a937-768b-4e9a-831a-6002defeab52" returned: 0 in 0.658s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-bcf4a937-768b-4e9a-831a-6002defeab52 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-bcf4a937-768b-4e9a-831a-6002defeab52" returned: 0 in 0.108s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Lock "cinder-quobyte-bcf4a937-768b-4e9a-831a-6002defeab52" released by "delete_volume" :: held 0.951s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Created reservations ['a435504a-1ab8-4f63-b9b3-5142af7193d3', 'cae220e1-c144-4a3b-a142-86d36929df26', 'd2721596-0ce1-43bc-89ff-0ae0f5696a93', 'b4a7de6d-1359-42d1-8a59-cef8759f74fd'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.142s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:27 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:17:27 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Deleted volume successfully. Sep 17 18:17:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5d5499f4-7baf-4f2e-8a16-a846f776ccc2 tempest-ServersNegativeTestJSON-596854249 None] Lock "cinder-bcf4a937-768b-4e9a-831a-6002defeab52-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:17:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Acquiring lock "cinder-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:17:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Lock "cinder-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:17:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:17:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Acquiring lock "cinder-quobyte-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:17:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Lock "cinder-quobyte-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc" acquired by "delete_volume" :: waited 0.014s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:17:28 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[165fbcd1-b7c4-4bb4-8fce-14b04f648e8e]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:17:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc" returned: 0 in 0.486s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc" returned: 0 in 0.124s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Lock "cinder-quobyte-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc" released by "delete_volume" :: held 0.785s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Created reservations ['fb8fc484-7627-4d35-ad1b-ca448636fb39', '4293cc96-1acb-4c70-8269-b505f2b1bc25', 'fc89a560-71ef-4102-920e-2c924b63c29e', 'b6561bca-1515-45ec-a1a4-dd7df4bb602c'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.116s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:17:29 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:17:29 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Deleted volume successfully. Sep 17 18:17:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4acb6a3-8979-4305-a0a4-113cf4e8ee69 tempest-ServersNegativeTestJSON-596854249 None] Lock "cinder-f2cd30e9-ffc9-470b-9d8e-0851ea5d6efc-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:17:39 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=6 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:17:40 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=24,cinder:DELETE=2,cinder:SELECT=14,cinder:INSERT=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:17:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-ba4c10a6-a02b-40e5-bca8-f7d99f0aacb5 req-df8ad274-0625-4bc5-9215-068a6b73ff39 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:17:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-ba4c10a6-a02b-40e5-bca8-f7d99f0aacb5 req-df8ad274-0625-4bc5-9215-068a6b73ff39 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:17:43 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-ba4c10a6-a02b-40e5-bca8-f7d99f0aacb5 req-df8ad274-0625-4bc5-9215-068a6b73ff39 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Terminate volume connection completed successfully. Sep 17 18:17:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-ba4c10a6-a02b-40e5-bca8-f7d99f0aacb5 req-df8ad274-0625-4bc5-9215-068a6b73ff39 tempest-AttachSCSIVolumeTestJSON-1546384124 None] Deleting attachment 22350b25-cfbf-4eb4-a079-26dcad040f1d. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:17:53 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:18:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Acquiring lock "cinder-de048742-7d5f-4524-9aaf-1af80cebbc92-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:18:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "cinder-de048742-7d5f-4524-9aaf-1af80cebbc92-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:18:01 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:18:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Acquiring lock "cinder-quobyte-de048742-7d5f-4524-9aaf-1af80cebbc92" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:18:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "cinder-quobyte-de048742-7d5f-4524-9aaf-1af80cebbc92" acquired by "delete_volume" :: waited 0.020s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:18:01 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fab022-6c9a-4e99-a917-b4e9cc6537a2]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:18:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-de048742-7d5f-4524-9aaf-1af80cebbc92 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:18:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-de048742-7d5f-4524-9aaf-1af80cebbc92" returned: 0 in 0.601s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:18:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-de048742-7d5f-4524-9aaf-1af80cebbc92 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:18:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-de048742-7d5f-4524-9aaf-1af80cebbc92" returned: 0 in 0.117s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:18:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "cinder-quobyte-de048742-7d5f-4524-9aaf-1af80cebbc92" released by "delete_volume" :: held 0.980s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:18:02 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Created reservations ['5ecb3ef6-ce72-40ad-a4e7-3bfaa3e645c3', 'c8a105ad-d4d7-487e-84f3-9af1058df722', '8419f789-a95b-4dd2-b4e6-e97a0c655ce3', '83ab90b7-fc3b-4083-a685-9efd90bdb5c0'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:18:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:18:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:18:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:18:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:18:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:18:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:18:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.141s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:18:03 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:18:03 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Deleted volume successfully. Sep 17 18:18:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7efd914c-b91b-4af1-8159-8a5fc36f45ff tempest-AttachSCSIVolumeTestJSON-1546384124 None] Lock "cinder-de048742-7d5f-4524-9aaf-1af80cebbc92-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:18:12 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:18:13 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:18:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:18:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:18:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:18:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:18:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:18:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:18:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:18:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.335s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:18:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:19:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-e04613ee-f313-4730-884b-16166f5c838f tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:19:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-e04613ee-f313-4730-884b-16166f5c838f tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:19:12 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-e04613ee-f313-4730-884b-16166f5c838f tempest-TaggedBootDevicesTest-1597936544 None] Terminate volume connection completed successfully. Sep 17 18:19:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-e04613ee-f313-4730-884b-16166f5c838f tempest-TaggedBootDevicesTest-1597936544 None] Deleting attachment 21d972f3-439d-4892-baa2-612183a8b327. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:19:13 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-38247dc6-52ad-461c-b117-158240fdd4bf tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:19:13 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-38247dc6-52ad-461c-b117-158240fdd4bf tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:19:13 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-38247dc6-52ad-461c-b117-158240fdd4bf tempest-TaggedBootDevicesTest-1597936544 None] Terminate volume connection completed successfully. Sep 17 18:19:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-38247dc6-52ad-461c-b117-158240fdd4bf tempest-TaggedBootDevicesTest-1597936544 None] Deleting attachment ce7335d1-5503-47df-8294-4f008c7d3547. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:19:14 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-79cb90d8-96dc-4c73-aa3a-d251bbb4f722 tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:19:14 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-79cb90d8-96dc-4c73-aa3a-d251bbb4f722 tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:19:14 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-79cb90d8-96dc-4c73-aa3a-d251bbb4f722 tempest-TaggedBootDevicesTest-1597936544 None] Terminate volume connection completed successfully. Sep 17 18:19:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-3e3c282f-1c30-4161-8b6b-cfb15124d887 req-79cb90d8-96dc-4c73-aa3a-d251bbb4f722 tempest-TaggedBootDevicesTest-1597936544 None] Deleting attachment 9a559922-3848-4b7a-929f-c47015efc9d3. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:19:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:19:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:19:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:19:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:19:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:19:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:19:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.302s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:19:24 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:19:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "cinder-663db78a-43f3-4053-be9b-6c74afde2391-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:19:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-663db78a-43f3-4053-be9b-6c74afde2391-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:19:25 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:19:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "cinder-quobyte-663db78a-43f3-4053-be9b-6c74afde2391" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:19:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-quobyte-663db78a-43f3-4053-be9b-6c74afde2391" acquired by "delete_volume" :: waited 0.010s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:19:25 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[908deacb-c1f4-46b1-aab0-52fa011796b2]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:19:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-663db78a-43f3-4053-be9b-6c74afde2391 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-663db78a-43f3-4053-be9b-6c74afde2391" returned: 0 in 0.429s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-663db78a-43f3-4053-be9b-6c74afde2391 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-663db78a-43f3-4053-be9b-6c74afde2391" returned: 0 in 0.100s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-quobyte-663db78a-43f3-4053-be9b-6c74afde2391" released by "delete_volume" :: held 0.715s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:19:26 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Created reservations ['67ff9758-e8b2-434c-b8ec-8872533484c5', '9ec81eb6-bc38-4125-939a-2c3a7c0f75a4', '1509f797-b6d8-4bd0-97bb-ef5da3d42154', '7dbb2758-6eb4-41bc-9d79-15106342e66d'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:19:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:19:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:19:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:19:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:19:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:19:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.124s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:26 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:19:26 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Deleted volume successfully. Sep 17 18:19:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1cc3f46d-339b-4015-a2b0-ffb148fd7a1a tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-663db78a-43f3-4053-be9b-6c74afde2391-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:19:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "cinder-ee0380a8-e228-4643-9263-6bc3d4b001a7-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:19:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-ee0380a8-e228-4643-9263-6bc3d4b001a7-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:19:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:19:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "cinder-quobyte-ee0380a8-e228-4643-9263-6bc3d4b001a7" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:19:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-quobyte-ee0380a8-e228-4643-9263-6bc3d4b001a7" acquired by "delete_volume" :: waited 0.017s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:19:28 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3723748-bdde-450a-8811-10dd03fd7ec5]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:19:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-ee0380a8-e228-4643-9263-6bc3d4b001a7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:28 devstack quobyte-client[83739]: System call of process 88399 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:19:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-ee0380a8-e228-4643-9263-6bc3d4b001a7" returned: 0 in 0.571s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-ee0380a8-e228-4643-9263-6bc3d4b001a7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-ee0380a8-e228-4643-9263-6bc3d4b001a7" returned: 0 in 0.147s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-quobyte-ee0380a8-e228-4643-9263-6bc3d4b001a7" released by "delete_volume" :: held 0.953s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:19:29 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Created reservations ['166e9976-3319-4d6e-baf9-faf41187b265', '31986410-02a9-4d39-82a7-7883fbcf0d75', 'ecf46015-129f-4cf8-ac4c-b1d5fe8d2150', 'afb70879-b133-4447-ba61-2f0ecf6a59e9'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:19:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:19:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:19:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:19:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:19:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:19:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "cinder-77153374-e591-4dde-88d6-dd724b5661cf-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:19:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 1.476s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-77153374-e591-4dde-88d6-dd724b5661cf-delete_volume" acquired by "delete_volume" :: waited 0.612s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:19:32 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:19:32 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Deleted volume successfully. Sep 17 18:19:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-723c20d1-c8c8-473f-a482-2b429838853e tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-ee0380a8-e228-4643-9263-6bc3d4b001a7-delete_volume" released by "delete_volume" :: held 4.449s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:19:32 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:19:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "cinder-quobyte-77153374-e591-4dde-88d6-dd724b5661cf" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:19:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-quobyte-77153374-e591-4dde-88d6-dd724b5661cf" acquired by "delete_volume" :: waited 0.048s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:19:32 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da19dcf-5585-4e37-9b25-82f092ff3aec]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:19:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:33 devstack quobyte-client[83739]: System call of process 88467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:19:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf" returned: 0 in 1.116s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf" returned: 1 in 0.853s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:19:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-77153374-e591-4dde-88d6-dd724b5661cf" returned: 0 in 0.275s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-quobyte-77153374-e591-4dde-88d6-dd724b5661cf" released by "delete_volume" :: held 2.798s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:19:35 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Created reservations ['55afe9aa-9b4d-48c9-b8ce-f6b450b4da91', '8307d265-c632-4658-9fb8-eeb1263797db', 'a8d7a9e8-4774-4540-92a3-1c30cbc61898', 'd8467d78-84a4-4499-b847-dad741e1faaf'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:19:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:19:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:19:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:19:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:19:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:19:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.108s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:35 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:19:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Deleted volume successfully. Sep 17 18:19:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c8fae102-9e53-4031-b31c-c127c0f2a1f3 tempest-TaggedBootDevicesTest-1597936544 None] Lock "cinder-77153374-e591-4dde-88d6-dd724b5661cf-delete_volume" released by "delete_volume" :: held 4.232s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:19:45 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=14,cinder:INSERT=9,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:19:46 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:19:56 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Flow 'volume_create_manager' (f01370ca-7b2d-4916-8e6b-70332104144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a749ba-0755-41f6-8e47-ffee9b1ab5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a749ba-0755-41f6-8e47-ffee9b1ab5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1163665533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46f5c92-c344-46b9-9773-0ed08b97b873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd17f886f794c6f9ca2083d1a15cd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:19:56Z,use_quota=True,user_id='3843de3dd8654fc3ad77b595fc56ee0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4457dd92-06fe-4cf3-a6a8-9b90a845a066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4457dd92-06fe-4cf3-a6a8-9b90a845a066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55dba1e-b5d9-4620-9d66-30708f85ff6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55dba1e-b5d9-4620-9d66-30708f85ff6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46f5c92-c344-46b9-9773-0ed08b97b873', 'volume_name': 'volume-a46f5c92-c344-46b9-9773-0ed08b97b873', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a282072a-5070-472c-ad6c-b8bed2457ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a282072a-5070-472c-ad6c-b8bed2457ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b79c0b-1cd7-4460-a38b-bc98be2c7d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:19:56 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume a46f5c92-c344-46b9-9773-0ed08b97b873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46f5c92-c344-46b9-9773-0ed08b97b873', 'volume_size': 1} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1163665533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46f5c92-c344-46b9-9773-0ed08b97b873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd17f886f794c6f9ca2083d1a15cd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:19:56Z,use_quota=True,user_id='3843de3dd8654fc3ad77b595fc56ee0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Creating volume a46f5c92-c344-46b9-9773-0ed08b97b873 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:19:56 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:19:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a46f5c92-c344-46b9-9773-0ed08b97b873 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:57 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=12, name=volume-a46f5c92-c344-46b9-9773-0ed08b97b873, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:19:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a46f5c92-c344-46b9-9773-0ed08b97b873 1073741824" returned: 0 in 0.562s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a46f5c92-c344-46b9-9773-0ed08b97b873 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:19:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a46f5c92-c344-46b9-9773-0ed08b97b873" returned: 0 in 0.136s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:19:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] <== create_volume: return (824ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:19:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:19:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b79c0b-1cd7-4460-a38b-bc98be2c7d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46f5c92-c344-46b9-9773-0ed08b97b873', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:19:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7315d5-ee8f-4390-85d9-1ab46f14c9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:19:57 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume volume-a46f5c92-c344-46b9-9773-0ed08b97b873 (a46f5c92-c344-46b9-9773-0ed08b97b873): created successfully Sep 17 18:19:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7315d5-ee8f-4390-85d9-1ab46f14c9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:19:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Flow 'volume_create_manager' (f01370ca-7b2d-4916-8e6b-70332104144b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:19:58 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-259feb81-7b66-419d-95fc-0425c085bf50 tempest-AttachVolumeShelveTestJSON-1264840312 None] Created volume successfully. Sep 17 18:20:07 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ba37abb7-cdd5-4c3b-89e3-b2929e74ffcf tempest-GroupSnapshotsV319Test-751777257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:07 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ba37abb7-cdd5-4c3b-89e3-b2929e74ffcf tempest-GroupSnapshotsV319Test-751777257 None] Group tempest-GroupSnapshotsV319Test-Group-2146317882: creating Sep 17 18:20:07 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ba37abb7-cdd5-4c3b-89e3-b2929e74ffcf tempest-GroupSnapshotsV319Test-751777257 None] Group tempest-GroupSnapshotsV319Test-Group-2146317882: created successfully Sep 17 18:20:08 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ba37abb7-cdd5-4c3b-89e3-b2929e74ffcf tempest-GroupSnapshotsV319Test-751777257 None] Create group completed successfully. Sep 17 18:20:08 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:08 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:20:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Flow 'volume_create_manager' (554272c9-d8cd-4d9a-afd7-ddd4d651106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:20:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d89c699-22be-460f-aa4e-90b0c06a1aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d89c699-22be-460f-aa4e-90b0c06a1aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533072760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19515651-f761-4c76-af3d-68a37bc8fab3,host='devstack@QuobyteHD#QuobyteHD',id=f4905bdb-3f82-43c7-a46c-44a69302b9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dde7ff5b1d64c7bafddb8d4a41d6f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:20:09Z,use_quota=True,user_id='dda95a2c9eb14527ab076db32f274a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(400bffa1-c095-46fb-8114-f3bfab588fc2),volume_type_id=400bffa1-c095-46fb-8114-f3bfab588fc2)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d855eee-1d2a-4dc4-9d83-b92502be3769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d855eee-1d2a-4dc4-9d83-b92502be3769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fd43b3-bd42-47d6-80ec-63045c7a038a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fd43b3-bd42-47d6-80ec-63045c7a038a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4905bdb-3f82-43c7-a46c-44a69302b9e5', 'volume_name': 'volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1175d478-1ca0-4a6c-b001-adea65ab0f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1175d478-1ca0-4a6c-b001-adea65ab0f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29ce65f-d8f9-4767-90dd-4da4068c32e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:09 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Volume f4905bdb-3f82-43c7-a46c-44a69302b9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5', 'volume_size': 1} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=19515651-f761-4c76-af3d-68a37bc8fab3,created_at=2025-09-17T16:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533072760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19515651-f761-4c76-af3d-68a37bc8fab3,host='devstack@QuobyteHD#QuobyteHD',id=f4905bdb-3f82-43c7-a46c-44a69302b9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dde7ff5b1d64c7bafddb8d4a41d6f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:20:09Z,use_quota=True,user_id='dda95a2c9eb14527ab076db32f274a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(400bffa1-c095-46fb-8114-f3bfab588fc2),volume_type_id=400bffa1-c095-46fb-8114-f3bfab588fc2)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Creating volume f4905bdb-3f82-43c7-a46c-44a69302b9e5 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:20:09 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:09 devstack quobyte-client[83739]: System call of process 88618 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:20:09 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=13, name=volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 1073741824" returned: 0 in 0.409s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5" returned: 0 in 0.156s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] <== create_volume: return (658ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:20:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29ce65f-d8f9-4767-90dd-4da4068c32e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b54cacb-cdf4-4ee3-86a3-85fff6b4238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:10 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Volume volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 (f4905bdb-3f82-43c7-a46c-44a69302b9e5): created successfully Sep 17 18:20:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b54cacb-cdf4-4ee3-86a3-85fff6b4238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Flow 'volume_create_manager' (554272c9-d8cd-4d9a-afd7-ddd4d651106c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:20:10 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7732c63d-bf86-4dc9-91e1-fc5198ccb6ee tempest-GroupSnapshotsV319Test-751777257 None] Created volume successfully. Sep 17 18:20:12 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] GroupSnapshot e0c63e87-0f8c-4090-9102-cea5110c03a0: creating. Sep 17 18:20:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Group snapshot e0c63e87-0f8c-4090-9102-cea5110c03a0: creating. {{(pid=83736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 17 18:20:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Creating offline snapshot 42473660-a285-4278-905a-b21888ef1c17 of volume f4905bdb-3f82-43c7-a46c-44a69302b9e5 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:20:12 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47080fa-f6e0-43b7-9d00-eea9ff0553f4]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:20:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5" returned: 0 in 0.482s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:13 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=14, name=volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17 1G" returned: 0 in 0.258s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:13 devstack quobyte-client[83739]: System call of process 88651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] CMD "qemu-img rebase -u -b volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17" returned: 0 in 0.174s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17" returned: 0 in 0.100s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17" returned: 0 in 0.084s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.info" returned: 0 in 0.118s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.info" returned: 0 in 0.087s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.668s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:14 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-32b4f9ac-377c-4627-9500-e17641133888 tempest-GroupSnapshotsV319Test-751777257 None] group_snapshot e0c63e87-0f8c-4090-9102-cea5110c03a0: created successfully Sep 17 18:20:15 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] group_snapshot e0c63e87-0f8c-4090-9102-cea5110c03a0: deleting Sep 17 18:20:15 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] group_snapshot e0c63e87-0f8c-4090-9102-cea5110c03a0: deleting {{(pid=83736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Acquiring lock "cinder-quobyte-f4905bdb-3f82-43c7-a46c-44a69302b9e5" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Lock "cinder-quobyte-f4905bdb-3f82-43c7-a46c-44a69302b9e5" acquired by "delete_snapshot" :: waited 0.184s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Acquiring lock "cinder-quobyte-42473660-a285-4278-905a-b21888ef1c17" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Lock "cinder-quobyte-42473660-a285-4278-905a-b21888ef1c17" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Deleting offline snapshot 42473660-a285-4278-905a-b21888ef1c17 of volume f4905bdb-3f82-43c7-a46c-44a69302b9e5 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] snapshot_file for this snap is: volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e767d71-68ee-4d4a-80c0-f9d45270afff]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.201s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:20:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17" returned: 0 in 0.859s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:20:17 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db9ec5f-7fa3-4174-9d8d-a2a9470dee32]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:20:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:17 devstack quobyte-client[83739]: System call of process 88669 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:20:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5" returned: 0 in 0.623s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17" returned: 0 in 0.453s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5.42473660-a285-4278-905a-b21888ef1c17" returned: 0 in 0.165s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Lock "cinder-quobyte-42473660-a285-4278-905a-b21888ef1c17" released by "_delete_snapshot" :: held 2.388s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:20:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Lock "cinder-quobyte-f4905bdb-3f82-43c7-a46c-44a69302b9e5" released by "delete_snapshot" :: held 2.418s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:20:19 devstack cinder-volume[83736]: WARNING cinder.quota [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2128210105 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2128210105, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:20:19 devstack cinder-volume[83736]: WARNING cinder.quota [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2128210105 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2128210105, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:20:19 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] Created reservations ['a4e22549-6db1-4484-9cfd-4a62d67e8915', 'a48d7609-2247-4b7a-9d6b-48b9a16e4b4c', '0b0ccab9-023a-45ec-a31d-67a33930c227', '98f50fc8-3b8a-41e4-b26a-b080021ab7c3'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:20:19 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-70c639b4-87f4-4b98-b6b8-2428bae0eb64 tempest-GroupSnapshotsV319Test-751777257 None] group_snapshot e0c63e87-0f8c-4090-9102-cea5110c03a0: deleted successfully Sep 17 18:20:20 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Acquiring lock "cinder-quobyte-f4905bdb-3f82-43c7-a46c-44a69302b9e5" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:20:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Lock "cinder-quobyte-f4905bdb-3f82-43c7-a46c-44a69302b9e5" acquired by "delete_volume" :: waited 0.018s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:20:20 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84ced53-1798-469d-bb91-33d5b620157e]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:20:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5" returned: 0 in 0.566s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f4905bdb-3f82-43c7-a46c-44a69302b9e5" returned: 0 in 0.137s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Lock "cinder-quobyte-f4905bdb-3f82-43c7-a46c-44a69302b9e5" released by "delete_volume" :: held 0.958s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:20:21 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Created reservations ['860a0884-9019-4182-a620-8eb34e4781b7'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:20:22 devstack cinder-volume[83736]: WARNING cinder.quota [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2128210105 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2128210105, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:20:22 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Created reservations ['723b4fc1-b82a-4c80-8b08-938ed5e23a04', '2b7228a5-c20d-4d4c-92b2-6689477bb574', 'ce62b9eb-ade9-4530-9143-d28e5d5aef62', 'acdeb112-e066-44f7-9c9f-cbbe49eac23f'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:20:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:20:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:20:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.088s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:22 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:20:22 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-52aef742-6324-4f8b-93b9-0ccedec83f0a tempest-GroupSnapshotsV319Test-751777257 None] Delete group completed successfully. Sep 17 18:20:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-335fa9d1-7a30-4264-a22d-5d165a10bdaf req-7d7170f9-848e-408a-a831-397b769e0dc2 tempest-AttachVolumeShelveTestJSON-1264840312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-335fa9d1-7a30-4264-a22d-5d165a10bdaf req-7d7170f9-848e-408a-a831-397b769e0dc2 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:26 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e0d1fb-d943-4d71-aeca-5cc82206fdf9]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:20:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-335fa9d1-7a30-4264-a22d-5d165a10bdaf req-7d7170f9-848e-408a-a831-397b769e0dc2 tempest-AttachVolumeShelveTestJSON-1264840312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a46f5c92-c344-46b9-9773-0ed08b97b873 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-335fa9d1-7a30-4264-a22d-5d165a10bdaf req-7d7170f9-848e-408a-a831-397b769e0dc2 tempest-AttachVolumeShelveTestJSON-1264840312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a46f5c92-c344-46b9-9773-0ed08b97b873" returned: 0 in 0.514s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-335fa9d1-7a30-4264-a22d-5d165a10bdaf req-7d7170f9-848e-408a-a831-397b769e0dc2 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.577s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-335fa9d1-7a30-4264-a22d-5d165a10bdaf req-7d7170f9-848e-408a-a831-397b769e0dc2 tempest-AttachVolumeShelveTestJSON-1264840312 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-a46f5c92-c344-46b9-9773-0ed08b97b873', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f4a4504-17b6-4df7-b806-15be4833cfe5', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:20:27 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-335fa9d1-7a30-4264-a22d-5d165a10bdaf req-7d7170f9-848e-408a-a831-397b769e0dc2 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:27 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-335fa9d1-7a30-4264-a22d-5d165a10bdaf req-7d7170f9-848e-408a-a831-397b769e0dc2 tempest-AttachVolumeShelveTestJSON-1264840312 None] attachment_update completed successfully. Sep 17 18:20:34 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c6517fce-5153-47e7-99cb-3366a6f7c37f tempest-GroupsTest-1593674086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:34 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c6517fce-5153-47e7-99cb-3366a6f7c37f tempest-GroupsTest-1593674086 None] Group tempest-Group1-561530690: creating Sep 17 18:20:34 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c6517fce-5153-47e7-99cb-3366a6f7c37f tempest-GroupsTest-1593674086 None] Group tempest-Group1-561530690: created successfully Sep 17 18:20:34 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c6517fce-5153-47e7-99cb-3366a6f7c37f tempest-GroupsTest-1593674086 None] Create group completed successfully. Sep 17 18:20:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-32d16722-854e-4ca4-b2ba-103cdc507f97 tempest-GroupsTest-1593674086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-32d16722-854e-4ca4-b2ba-103cdc507f97 tempest-GroupsTest-1593674086 None] Group tempest-Group2-2124408586: creating Sep 17 18:20:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-32d16722-854e-4ca4-b2ba-103cdc507f97 tempest-GroupsTest-1593674086 None] Group tempest-Group2-2124408586: created successfully Sep 17 18:20:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-32d16722-854e-4ca4-b2ba-103cdc507f97 tempest-GroupsTest-1593674086 None] Create group completed successfully. Sep 17 18:20:37 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:37 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Flow 'volume_create_manager' (606c3b52-eaf3-4a1a-a9ef-6cd57fec2cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da007640-739d-4ac4-a821-caa0d71425d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da007640-739d-4ac4-a821-caa0d71425d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271056756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4221a6a-3f7d-4263-8b06-a8d23277041b,host='devstack@QuobyteHD#QuobyteHD',id=1f2a7083-119c-4404-92b8-1822936c0ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00ee0e7e39d465dbc183fbbf91c04bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:20:38Z,use_quota=True,user_id='696149206e764ff78f254cc0ad9f98b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6abe5ea8-079f-479b-a8e7-578e56a88d19),volume_type_id=6abe5ea8-079f-479b-a8e7-578e56a88d19)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54ea06b-7682-4132-a3c7-93cd534a8d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54ea06b-7682-4132-a3c7-93cd534a8d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde981c9-a229-4275-9904-eb26579d8a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde981c9-a229-4275-9904-eb26579d8a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2a7083-119c-4404-92b8-1822936c0ea4', 'volume_name': 'volume-1f2a7083-119c-4404-92b8-1822936c0ea4', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c7ccf8-ccd7-4563-8233-5c8a47e7e5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c7ccf8-ccd7-4563-8233-5c8a47e7e5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18afc02c-c4e5-43b5-af5b-585e6fd60969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:38 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Volume 1f2a7083-119c-4404-92b8-1822936c0ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2a7083-119c-4404-92b8-1822936c0ea4', 'volume_size': 1} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a4221a6a-3f7d-4263-8b06-a8d23277041b,created_at=2025-09-17T16:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271056756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4221a6a-3f7d-4263-8b06-a8d23277041b,host='devstack@QuobyteHD#QuobyteHD',id=1f2a7083-119c-4404-92b8-1822936c0ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00ee0e7e39d465dbc183fbbf91c04bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:20:38Z,use_quota=True,user_id='696149206e764ff78f254cc0ad9f98b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6abe5ea8-079f-479b-a8e7-578e56a88d19),volume_type_id=6abe5ea8-079f-479b-a8e7-578e56a88d19)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Creating volume 1f2a7083-119c-4404-92b8-1822936c0ea4 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:20:38 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1f2a7083-119c-4404-92b8-1822936c0ea4 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:38 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=16, name=volume-1f2a7083-119c-4404-92b8-1822936c0ea4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1f2a7083-119c-4404-92b8-1822936c0ea4 1073741824" returned: 0 in 0.376s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1f2a7083-119c-4404-92b8-1822936c0ea4 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1f2a7083-119c-4404-92b8-1822936c0ea4" returned: 0 in 0.082s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] <== create_volume: return (531ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:20:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.544s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18afc02c-c4e5-43b5-af5b-585e6fd60969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2a7083-119c-4404-92b8-1822936c0ea4', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a5ce1a-dc16-4484-b1d8-1fec26baaa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:39 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Volume volume-1f2a7083-119c-4404-92b8-1822936c0ea4 (1f2a7083-119c-4404-92b8-1822936c0ea4): created successfully Sep 17 18:20:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a5ce1a-dc16-4484-b1d8-1fec26baaa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Flow 'volume_create_manager' (606c3b52-eaf3-4a1a-a9ef-6cd57fec2cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:20:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-95d94749-1a5b-4d36-82b6-0e263fa1da2f tempest-GroupsTest-1593674086 None] Created volume successfully. Sep 17 18:20:41 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Acquiring lock "cinder-quobyte-1f2a7083-119c-4404-92b8-1822936c0ea4" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:20:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Lock "cinder-quobyte-1f2a7083-119c-4404-92b8-1822936c0ea4" acquired by "delete_volume" :: waited 0.091s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:20:41 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[58707e22-a815-47d2-8aec-77fce7889fe3]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:20:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1f2a7083-119c-4404-92b8-1822936c0ea4 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:42 devstack quobyte-client[83739]: System call of process 88738 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:20:42 devstack quobyte-client[83739]: System call of process 88738 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:20:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1f2a7083-119c-4404-92b8-1822936c0ea4" returned: 0 in 1.460s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1f2a7083-119c-4404-92b8-1822936c0ea4 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1f2a7083-119c-4404-92b8-1822936c0ea4" returned: 0 in 0.179s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:43 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Lock "cinder-quobyte-1f2a7083-119c-4404-92b8-1822936c0ea4" released by "delete_volume" :: held 2.010s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:20:43 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Created reservations ['ddbaeaae-7d77-4a1e-a49d-db9f0ba6a7fc'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:20:43 devstack cinder-volume[83736]: WARNING cinder.quota [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1294482427 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1294482427, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:20:43 devstack cinder-volume[83736]: WARNING cinder.quota [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1294482427 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1294482427, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:20:43 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Created reservations ['d9d6d198-76ed-48b2-affc-a10636a0fb37', '424ca848-f34d-4e28-aa78-aaf21ee5b0dc', 'e79af82e-0c34-4788-aa6f-2d42b0ed3573', '29d36c04-6e6b-4ace-b421-dcd35dae9d44'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:20:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:20:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:20:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.137s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:44 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:20:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c3c15717-859c-41cb-836a-bd62c481de13 tempest-GroupsTest-1593674086 None] Delete group completed successfully. Sep 17 18:20:44 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d3f10b01-e37a-45c0-b328-61a6114288c4 tempest-GroupsTest-1593674086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:45 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-d3f10b01-e37a-45c0-b328-61a6114288c4 tempest-GroupsTest-1593674086 None] Created reservations ['da62d575-a615-4ef7-aa34-475d8efafa8b'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:20:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d3f10b01-e37a-45c0-b328-61a6114288c4 tempest-GroupsTest-1593674086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d3f10b01-e37a-45c0-b328-61a6114288c4 tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d3f10b01-e37a-45c0-b328-61a6114288c4 tempest-GroupsTest-1593674086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:20:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d3f10b01-e37a-45c0-b328-61a6114288c4 tempest-GroupsTest-1593674086 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:20:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d3f10b01-e37a-45c0-b328-61a6114288c4 tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d3f10b01-e37a-45c0-b328-61a6114288c4 tempest-GroupsTest-1593674086 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d3f10b01-e37a-45c0-b328-61a6114288c4 tempest-GroupsTest-1593674086 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.189s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:45 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-d3f10b01-e37a-45c0-b328-61a6114288c4 tempest-GroupsTest-1593674086 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:20:45 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d3f10b01-e37a-45c0-b328-61a6114288c4 tempest-GroupsTest-1593674086 None] Delete group completed successfully. Sep 17 18:20:47 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-024e8bc6-1f9c-46a5-91ff-e994770f2908 tempest-GroupsTest-1593674086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:47 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-024e8bc6-1f9c-46a5-91ff-e994770f2908 tempest-GroupsTest-1593674086 None] Group tempest-GroupsTest-Group-1279619009: creating Sep 17 18:20:47 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-024e8bc6-1f9c-46a5-91ff-e994770f2908 tempest-GroupsTest-1593674086 None] Group tempest-GroupsTest-Group-1279619009: created successfully Sep 17 18:20:47 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-024e8bc6-1f9c-46a5-91ff-e994770f2908 tempest-GroupsTest-1593674086 None] Create group completed successfully. Sep 17 18:20:48 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Flow 'volume_create_manager' (f924d6fa-f4ac-4091-8ef6-b8e67ae15afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291fd9ea-8892-4aa1-a13c-13fa8857777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291fd9ea-8892-4aa1-a13c-13fa8857777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2087240590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd510590-96a3-490b-9841-5c98d05f7e49,host='devstack@QuobyteHD#QuobyteHD',id=21d2f847-ae47-421b-935a-f0a18e71801f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00ee0e7e39d465dbc183fbbf91c04bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:20:49Z,use_quota=True,user_id='696149206e764ff78f254cc0ad9f98b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b67f521-a1cb-4b45-b160-50d168931f5b),volume_type_id=6b67f521-a1cb-4b45-b160-50d168931f5b)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1c9a92-3042-41a0-bb6c-e0f7c6c1ee56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1c9a92-3042-41a0-bb6c-e0f7c6c1ee56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b3490e-eb0c-4140-ab6c-414e3156c628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b3490e-eb0c-4140-ab6c-414e3156c628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d2f847-ae47-421b-935a-f0a18e71801f', 'volume_name': 'volume-21d2f847-ae47-421b-935a-f0a18e71801f', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b523766e-3b41-4b6b-942b-b4af0c2efb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b523766e-3b41-4b6b-942b-b4af0c2efb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b904f0c-81b4-46ec-8f98-ee9e68004873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:48 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Volume 21d2f847-ae47-421b-935a-f0a18e71801f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d2f847-ae47-421b-935a-f0a18e71801f', 'volume_size': 1} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd510590-96a3-490b-9841-5c98d05f7e49,created_at=2025-09-17T16:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2087240590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd510590-96a3-490b-9841-5c98d05f7e49,host='devstack@QuobyteHD#QuobyteHD',id=21d2f847-ae47-421b-935a-f0a18e71801f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00ee0e7e39d465dbc183fbbf91c04bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:20:49Z,use_quota=True,user_id='696149206e764ff78f254cc0ad9f98b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b67f521-a1cb-4b45-b160-50d168931f5b),volume_type_id=6b67f521-a1cb-4b45-b160-50d168931f5b)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Creating volume 21d2f847-ae47-421b-935a-f0a18e71801f {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:20:48 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:20:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-21d2f847-ae47-421b-935a-f0a18e71801f 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:49 devstack quobyte-client[83739]: System call of process 88786 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:20:49 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=17, name=volume-21d2f847-ae47-421b-935a-f0a18e71801f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:20:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-21d2f847-ae47-421b-935a-f0a18e71801f 1073741824" returned: 0 in 0.491s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-21d2f847-ae47-421b-935a-f0a18e71801f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-21d2f847-ae47-421b-935a-f0a18e71801f" returned: 0 in 0.338s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] <== create_volume: return (1008ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:20:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b904f0c-81b4-46ec-8f98-ee9e68004873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d2f847-ae47-421b-935a-f0a18e71801f', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac428b3a-79b3-4e43-ace3-fdddd5b71ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:50 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Volume volume-21d2f847-ae47-421b-935a-f0a18e71801f (21d2f847-ae47-421b-935a-f0a18e71801f): created successfully Sep 17 18:20:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac428b3a-79b3-4e43-ace3-fdddd5b71ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Flow 'volume_create_manager' (f924d6fa-f4ac-4091-8ef6-b8e67ae15afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:20:50 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-84a7714f-0912-4617-bab9-85724c2c557c tempest-GroupsTest-1593674086 None] Created volume successfully. Sep 17 18:20:50 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:50 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Flow 'volume_create_manager' (bd68c70b-e5b1-48c9-8827-54e97f7983d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85314910-e80a-4d06-9cf0-32fc6b51dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85314910-e80a-4d06-9cf0-32fc6b51dee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-559356178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2672b6d8-8e19-4e98-a791-ea43e3911379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0246f69124634d03b9fac141b12d7aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:20:51Z,use_quota=True,user_id='d3a394aef2134f8c901c6baf0d448753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e6e042-3663-4434-be30-a18758a9ed2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e6e042-3663-4434-be30-a18758a9ed2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebe1499-0407-4199-b2ff-d02a6383fcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebe1499-0407-4199-b2ff-d02a6383fcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2672b6d8-8e19-4e98-a791-ea43e3911379', 'volume_name': 'volume-2672b6d8-8e19-4e98-a791-ea43e3911379', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e175a04-6cd9-4ffa-b879-c87dfbd9a000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e175a04-6cd9-4ffa-b879-c87dfbd9a000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a4b9d0-2513-477b-a8ee-adcd7daca6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:51 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Volume 2672b6d8-8e19-4e98-a791-ea43e3911379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2672b6d8-8e19-4e98-a791-ea43e3911379', 'volume_size': 1} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-559356178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2672b6d8-8e19-4e98-a791-ea43e3911379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0246f69124634d03b9fac141b12d7aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:20:51Z,use_quota=True,user_id='d3a394aef2134f8c901c6baf0d448753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Creating volume 2672b6d8-8e19-4e98-a791-ea43e3911379 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:20:51 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2672b6d8-8e19-4e98-a791-ea43e3911379 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:51 devstack quobyte-client[83739]: System call of process 88793 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:20:51 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=18, name=volume-2672b6d8-8e19-4e98-a791-ea43e3911379, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2672b6d8-8e19-4e98-a791-ea43e3911379 1073741824" returned: 0 in 0.525s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2672b6d8-8e19-4e98-a791-ea43e3911379 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2672b6d8-8e19-4e98-a791-ea43e3911379" returned: 0 in 0.202s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] <== create_volume: return (936ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a4b9d0-2513-477b-a8ee-adcd7daca6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2672b6d8-8e19-4e98-a791-ea43e3911379', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ad3581-0be8-4ed9-a0c8-8b523ffdd84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:52 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Volume volume-2672b6d8-8e19-4e98-a791-ea43e3911379 (2672b6d8-8e19-4e98-a791-ea43e3911379): created successfully Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ad3581-0be8-4ed9-a0c8-8b523ffdd84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Flow 'volume_create_manager' (bd68c70b-e5b1-48c9-8827-54e97f7983d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:20:52 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Flow 'volume_create_manager' (0f9e1070-b9ab-4451-bf37-c5cefd04ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1125b7-f142-4cda-a922-9d4cff85cd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1125b7-f142-4cda-a922-9d4cff85cd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-21705713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd510590-96a3-490b-9841-5c98d05f7e49,host='devstack@QuobyteHD#QuobyteHD',id=8d53bda6-3fb7-4186-bd94-65328e4d3fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00ee0e7e39d465dbc183fbbf91c04bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:20:52Z,use_quota=True,user_id='696149206e764ff78f254cc0ad9f98b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b67f521-a1cb-4b45-b160-50d168931f5b),volume_type_id=6b67f521-a1cb-4b45-b160-50d168931f5b)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155fd39e-24c0-491a-8cdd-c0d222841e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155fd39e-24c0-491a-8cdd-c0d222841e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10a27c4-e3be-40b1-a167-5df08e5768dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10a27c4-e3be-40b1-a167-5df08e5768dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d53bda6-3fb7-4186-bd94-65328e4d3fdd', 'volume_name': 'volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960b865c-192f-4c40-973c-5a998d26df74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960b865c-192f-4c40-973c-5a998d26df74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd8e899-c5fa-4eff-a649-51455d3a17c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:52 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Volume 8d53bda6-3fb7-4186-bd94-65328e4d3fdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd', 'volume_size': 1} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd510590-96a3-490b-9841-5c98d05f7e49,created_at=2025-09-17T16:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-21705713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd510590-96a3-490b-9841-5c98d05f7e49,host='devstack@QuobyteHD#QuobyteHD',id=8d53bda6-3fb7-4186-bd94-65328e4d3fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00ee0e7e39d465dbc183fbbf91c04bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:20:52Z,use_quota=True,user_id='696149206e764ff78f254cc0ad9f98b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b67f521-a1cb-4b45-b160-50d168931f5b),volume_type_id=6b67f521-a1cb-4b45-b160-50d168931f5b)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Creating volume 8d53bda6-3fb7-4186-bd94-65328e4d3fdd {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:20:52 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:20:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:52 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-804142f4-f176-4f43-b7d4-f3b5150edca8 tempest-AttachVolumeNegativeTest-680660464 None] Created volume successfully. Sep 17 18:20:52 devstack quobyte-client[83739]: System call of process 88866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:20:52 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=19, name=volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:20:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd 1073741824" returned: 0 in 0.399s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd" returned: 0 in 0.128s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:20:53 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] <== create_volume: return (571ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:20:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.583s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:20:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd8e899-c5fa-4eff-a649-51455d3a17c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd958a9-fa87-4215-9afd-d5cc755e8caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:20:53 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Volume volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd (8d53bda6-3fb7-4186-bd94-65328e4d3fdd): created successfully Sep 17 18:20:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd958a9-fa87-4215-9afd-d5cc755e8caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:20:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Flow 'volume_create_manager' (0f9e1070-b9ab-4451-bf37-c5cefd04ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:20:53 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7948808b-e2fc-4d7b-955d-e1fd55fd47ff tempest-GroupsTest-1593674086 None] Created volume successfully. Sep 17 18:20:54 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-485d6180-c2e4-4317-be08-3ee1470e7ce3 tempest-GroupsTest-1593674086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:55 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-485d6180-c2e4-4317-be08-3ee1470e7ce3 tempest-GroupsTest-1593674086 None] Update group completed successfully. Sep 17 18:20:56 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=57,cinder:UPDATE=38,cinder:INSERT=7,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:20:56 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=55,cinder:UPDATE=62,cinder:DELETE=5,cinder:INSERT=8 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:20:56 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-954ea3b0-1f43-43c4-a03e-8d4cb19046cd tempest-GroupsTest-1593674086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:56 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-954ea3b0-1f43-43c4-a03e-8d4cb19046cd tempest-GroupsTest-1593674086 None] Update group completed successfully. Sep 17 18:20:58 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:20:58 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Acquiring lock "cinder-quobyte-21d2f847-ae47-421b-935a-f0a18e71801f" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:20:58 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Lock "cinder-quobyte-21d2f847-ae47-421b-935a-f0a18e71801f" acquired by "delete_volume" :: waited 0.064s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:20:58 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd53f81-c329-4dc8-bee5-4010616da767]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:20:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-21d2f847-ae47-421b-935a-f0a18e71801f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:20:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-4ac80e29-6eb1-4cdc-8803-e2bba2fcfac5 req-f9c48bc0-4fb3-4ec5-8a73-8ea2df5409ed tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:20:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-4ac80e29-6eb1-4cdc-8803-e2bba2fcfac5 req-f9c48bc0-4fb3-4ec5-8a73-8ea2df5409ed tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.077s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:20:59 devstack quobyte-client[83739]: System call of process 89222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:20:59 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea18cc6-663e-4da9-9aff-f971ebd99483]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:20:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-4ac80e29-6eb1-4cdc-8803-e2bba2fcfac5 req-f9c48bc0-4fb3-4ec5-8a73-8ea2df5409ed tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2672b6d8-8e19-4e98-a791-ea43e3911379 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-21d2f847-ae47-421b-935a-f0a18e71801f" returned: 0 in 1.692s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-21d2f847-ae47-421b-935a-f0a18e71801f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-21d2f847-ae47-421b-935a-f0a18e71801f" returned: 0 in 0.463s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Lock "cinder-quobyte-21d2f847-ae47-421b-935a-f0a18e71801f" released by "delete_volume" :: held 2.672s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:21:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Acquiring lock "cinder-quobyte-8d53bda6-3fb7-4186-bd94-65328e4d3fdd" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:21:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Lock "cinder-quobyte-8d53bda6-3fb7-4186-bd94-65328e4d3fdd" acquired by "delete_volume" :: waited 0.152s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:21:01 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afcebf5-1543-4af6-8c52-e4435a5347a0]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:21:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-4ac80e29-6eb1-4cdc-8803-e2bba2fcfac5 req-f9c48bc0-4fb3-4ec5-8a73-8ea2df5409ed tempest-AttachVolumeNegativeTest-680660464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2672b6d8-8e19-4e98-a791-ea43e3911379" returned: 0 in 1.947s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-4ac80e29-6eb1-4cdc-8803-e2bba2fcfac5 req-f9c48bc0-4fb3-4ec5-8a73-8ea2df5409ed tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.185s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:21:02 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-4ac80e29-6eb1-4cdc-8803-e2bba2fcfac5 req-f9c48bc0-4fb3-4ec5-8a73-8ea2df5409ed tempest-AttachVolumeNegativeTest-680660464 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-2672b6d8-8e19-4e98-a791-ea43e3911379', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e580c8a-ef3f-44a1-8de8-4570a5a98fd2', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:21:02 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-4ac80e29-6eb1-4cdc-8803-e2bba2fcfac5 req-f9c48bc0-4fb3-4ec5-8a73-8ea2df5409ed tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:21:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd" returned: 0 in 1.078s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8d53bda6-3fb7-4186-bd94-65328e4d3fdd" returned: 0 in 0.526s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:03 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-4ac80e29-6eb1-4cdc-8803-e2bba2fcfac5 req-f9c48bc0-4fb3-4ec5-8a73-8ea2df5409ed tempest-AttachVolumeNegativeTest-680660464 None] attachment_update completed successfully. Sep 17 18:21:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Lock "cinder-quobyte-8d53bda6-3fb7-4186-bd94-65328e4d3fdd" released by "delete_volume" :: held 1.824s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:21:03 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Created reservations ['cf61cd27-f8e8-4ecc-aa16-a83c104f952d'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:21:03 devstack cinder-volume[83736]: WARNING cinder.quota [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-160083447 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-160083447, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:21:03 devstack cinder-volume[83736]: WARNING cinder.quota [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-160083447 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-160083447, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:21:03 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Created reservations ['4029a769-0e27-4119-9028-a3a83aa43aa0', '2f6eb8f4-9ebf-447a-bed6-1f23d05ac53b', '52d3eebd-72f6-4725-bd32-b3f955313ca9', '5ddb59f7-a6e8-493a-8b5b-941fcd974889'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:21:03 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Created reservations ['79cb6663-c172-4135-a8ad-1ea0d6c6cb36', '84d5054b-bb5f-410b-9046-a84c3d7812a1', '84443f5a-7d3e-48b8-b469-21501874b238', '398ab2fc-8338-45be-92e4-adc491d4e73c'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:21:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:21:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:21:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:21:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:21:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:21:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.295s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:04 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:21:05 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ec682ba0-6698-4c18-87a2-bc362900cad6 tempest-GroupsTest-1593674086 None] Delete group completed successfully. Sep 17 18:21:14 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=7 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:21:14 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=18,cinder:SELECT=17,cinder:INSERT=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:21:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:21:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:21:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:21:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:21:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:21:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:21:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.216s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:21:27 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:21:27 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:21:54 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Flow 'volume_create_manager' (ccaa1e56-1a63-4665-90aa-001bdc403b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd1a4505-9b37-4bcb-a67c-8ed0c475a210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd1a4505-9b37-4bcb-a67c-8ed0c475a210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-835610281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7453a018-3a39-45d2-a3f4-b9600fa52359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9acf0854e984041b7103c2156e20962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:21:54Z,use_quota=True,user_id='4025c10c4c204a8a9e73f8850efc6dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48c1b54-b750-4170-ae71-430483e69f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48c1b54-b750-4170-ae71-430483e69f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a834aec8-84b4-4653-a2e6-53d790507910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a834aec8-84b4-4653-a2e6-53d790507910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7453a018-3a39-45d2-a3f4-b9600fa52359', 'volume_name': 'volume-7453a018-3a39-45d2-a3f4-b9600fa52359', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c174be20-e611-4391-87a7-a33f1adfe3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c174be20-e611-4391-87a7-a33f1adfe3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412ab7d2-82cf-49bd-849e-d1d29186acb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:21:54 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Volume 7453a018-3a39-45d2-a3f4-b9600fa52359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7453a018-3a39-45d2-a3f4-b9600fa52359', 'volume_size': 1} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-835610281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7453a018-3a39-45d2-a3f4-b9600fa52359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9acf0854e984041b7103c2156e20962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:21:54Z,use_quota=True,user_id='4025c10c4c204a8a9e73f8850efc6dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Creating volume 7453a018-3a39-45d2-a3f4-b9600fa52359 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:21:54 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7453a018-3a39-45d2-a3f4-b9600fa52359 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:54 devstack quobyte-client[83739]: System call of process 89520 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:21:54 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=20, name=volume-7453a018-3a39-45d2-a3f4-b9600fa52359, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7453a018-3a39-45d2-a3f4-b9600fa52359 1073741824" returned: 0 in 0.381s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7453a018-3a39-45d2-a3f4-b9600fa52359 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7453a018-3a39-45d2-a3f4-b9600fa52359" returned: 0 in 0.239s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:55 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] <== create_volume: return (707ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:21:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:21:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412ab7d2-82cf-49bd-849e-d1d29186acb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7453a018-3a39-45d2-a3f4-b9600fa52359', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:21:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7e61cd-a72f-4749-a4ee-c41ff2b9111e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:21:55 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Volume volume-7453a018-3a39-45d2-a3f4-b9600fa52359 (7453a018-3a39-45d2-a3f4-b9600fa52359): created successfully Sep 17 18:21:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7e61cd-a72f-4749-a4ee-c41ff2b9111e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:21:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Flow 'volume_create_manager' (ccaa1e56-1a63-4665-90aa-001bdc403b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:21:55 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-cd99992a-fd89-4e37-aa3e-69852f26291e tempest-VolumeQuotasAdminTestJSON-1534403196 None] Created volume successfully. Sep 17 18:21:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Acquiring lock "cinder-7453a018-3a39-45d2-a3f4-b9600fa52359-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:21:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "cinder-7453a018-3a39-45d2-a3f4-b9600fa52359-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:21:56 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:21:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Acquiring lock "cinder-quobyte-7453a018-3a39-45d2-a3f4-b9600fa52359" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:21:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "cinder-quobyte-7453a018-3a39-45d2-a3f4-b9600fa52359" acquired by "delete_volume" :: waited 0.030s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:21:56 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab777e5-8188-498d-b0ef-57d11926a333]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:21:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7453a018-3a39-45d2-a3f4-b9600fa52359 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7453a018-3a39-45d2-a3f4-b9600fa52359" returned: 0 in 0.582s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7453a018-3a39-45d2-a3f4-b9600fa52359 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7453a018-3a39-45d2-a3f4-b9600fa52359" returned: 0 in 0.176s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "cinder-quobyte-7453a018-3a39-45d2-a3f4-b9600fa52359" released by "delete_volume" :: held 0.960s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:21:58 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Created reservations ['4f802c8b-25ca-4390-95dc-ea9328440130', '8f3dd1c7-0c65-4375-9e2b-d4eca2e6ec30', '0a8e6bcd-ee41-4298-a76b-e586433e3c60', '3323f29b-d9fd-4ec6-8933-a21a112858df'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:21:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:21:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:21:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:21:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:21:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:21:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.133s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:21:58 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:21:58 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Deleted volume successfully. Sep 17 18:21:58 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-616a6eec-af35-48dd-93fe-c1e0c1c82137 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "cinder-7453a018-3a39-45d2-a3f4-b9600fa52359-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:21:59 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Flow 'volume_create_manager' (ef12b399-b054-4e51-8be3-05a3484a5eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b814dd7-e2a0-4ee4-ab2a-fe7d4bef12c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b814dd7-e2a0-4ee4-ab2a-fe7d4bef12c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1918070155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d99b4f-37b1-46e2-a86e-1566ef02bcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9acf0854e984041b7103c2156e20962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:21:59Z,use_quota=True,user_id='4025c10c4c204a8a9e73f8850efc6dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d870c118-d4f4-4cad-9560-1dd87ab9021c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d870c118-d4f4-4cad-9560-1dd87ab9021c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550b8851-b2c8-4a7e-a7b9-f4493e2d8582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550b8851-b2c8-4a7e-a7b9-f4493e2d8582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d99b4f-37b1-46e2-a86e-1566ef02bcac', 'volume_name': 'volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325a91cb-4d63-4938-b6f8-76e7fe614c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325a91cb-4d63-4938-b6f8-76e7fe614c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d9c06e-e891-47ad-af8f-8ba4aaef99b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:21:59 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Volume 81d99b4f-37b1-46e2-a86e-1566ef02bcac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac', 'volume_size': 1} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1918070155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d99b4f-37b1-46e2-a86e-1566ef02bcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9acf0854e984041b7103c2156e20962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:21:59Z,use_quota=True,user_id='4025c10c4c204a8a9e73f8850efc6dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Creating volume 81d99b4f-37b1-46e2-a86e-1566ef02bcac {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:21:59 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:21:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:21:59 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=21, name=volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:22:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac 1073741824" returned: 0 in 0.386s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac" returned: 0 in 0.226s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:00 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] <== create_volume: return (714ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:22:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:22:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d9c06e-e891-47ad-af8f-8ba4aaef99b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2839e2d7-dd11-43a7-bbee-66df4a73d627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:00 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Volume volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac (81d99b4f-37b1-46e2-a86e-1566ef02bcac): created successfully Sep 17 18:22:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2839e2d7-dd11-43a7-bbee-66df4a73d627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Flow 'volume_create_manager' (ef12b399-b054-4e51-8be3-05a3484a5eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:22:00 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-64afb633-2982-4278-a36f-677871d68de8 tempest-VolumeQuotasAdminTestJSON-1534403196 None] Created volume successfully. Sep 17 18:22:02 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-3fda2a11-5629-4d49-be7d-89600166f7f9 tempest-VolumeQuotasAdminTestJSON-976281100 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:22:02 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-3fda2a11-5629-4d49-be7d-89600166f7f9 tempest-VolumeQuotasAdminTestJSON-976281100 None] Transfer volume completed successfully. Sep 17 18:22:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Acquiring lock "cinder-81d99b4f-37b1-46e2-a86e-1566ef02bcac-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:22:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Lock "cinder-81d99b4f-37b1-46e2-a86e-1566ef02bcac-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:22:03 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:22:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Acquiring lock "cinder-quobyte-81d99b4f-37b1-46e2-a86e-1566ef02bcac" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:22:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Lock "cinder-quobyte-81d99b4f-37b1-46e2-a86e-1566ef02bcac" acquired by "delete_volume" :: waited 0.015s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:22:03 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87af6d3-26e0-4645-b11b-a1159c0f4274]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:22:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:04 devstack quobyte-client[83739]: System call of process 89550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:22:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac" returned: 0 in 0.825s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-81d99b4f-37b1-46e2-a86e-1566ef02bcac" returned: 0 in 0.289s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:05 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Lock "cinder-quobyte-81d99b4f-37b1-46e2-a86e-1566ef02bcac" released by "delete_volume" :: held 1.322s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:22:05 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Created reservations ['44940d69-bc96-4fd7-aaa2-ff81050e7aae', 'f77bb520-71da-46e9-be2e-b210eb862928', 'f1c30732-0545-4916-b69a-fcdfa5abe7ee', '0a1cfd86-bcde-413e-bbe9-1e6a1e3c6b75'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:22:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:22:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:22:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:22:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:22:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:22:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.133s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:05 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:22:05 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Deleted volume successfully. Sep 17 18:22:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3446c0bd-454b-440c-813e-0156b376ae9b tempest-VolumeQuotasAdminTestJSON-904335563 None] Lock "cinder-81d99b4f-37b1-46e2-a86e-1566ef02bcac-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:22:14 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Flow 'volume_create_manager' (2e8d7395-a822-438f-b073-bc9801de877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134acfdb-b1bf-427d-a5af-7eb85d8e55ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134acfdb-b1bf-427d-a5af-7eb85d8e55ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-899648533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2870d977-4dd0-4520-be5c-8a974d078c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760c7120167a4de4a4f2a59e2a365a0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:22:14Z,use_quota=True,user_id='f99cc47b49f648159acdc083651f454a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea5984d-28b0-495c-aa80-5415f6c54980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea5984d-28b0-495c-aa80-5415f6c54980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c38f40-5ef9-4ece-9787-8caf791193fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c38f40-5ef9-4ece-9787-8caf791193fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2870d977-4dd0-4520-be5c-8a974d078c1c', 'volume_name': 'volume-2870d977-4dd0-4520-be5c-8a974d078c1c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b94d5d-7ed3-4f59-9d65-229c45f2d96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b94d5d-7ed3-4f59-9d65-229c45f2d96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d141b75-74cb-4be3-a749-ae5608bdb43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:14 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Volume 2870d977-4dd0-4520-be5c-8a974d078c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2870d977-4dd0-4520-be5c-8a974d078c1c', 'volume_size': 1} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-899648533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2870d977-4dd0-4520-be5c-8a974d078c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760c7120167a4de4a4f2a59e2a365a0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:22:14Z,use_quota=True,user_id='f99cc47b49f648159acdc083651f454a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Creating volume 2870d977-4dd0-4520-be5c-8a974d078c1c {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:22:14 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:22:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2870d977-4dd0-4520-be5c-8a974d078c1c 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:15 devstack quobyte-client[83739]: System call of process 89587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:22:15 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=22, name=volume-2870d977-4dd0-4520-be5c-8a974d078c1c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:22:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2870d977-4dd0-4520-be5c-8a974d078c1c 1073741824" returned: 0 in 0.428s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2870d977-4dd0-4520-be5c-8a974d078c1c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2870d977-4dd0-4520-be5c-8a974d078c1c" returned: 0 in 0.093s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] <== create_volume: return (617ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:22:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.637s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:22:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d141b75-74cb-4be3-a749-ae5608bdb43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2870d977-4dd0-4520-be5c-8a974d078c1c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea274950-0468-4360-b049-ba410e7f328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:15 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Volume volume-2870d977-4dd0-4520-be5c-8a974d078c1c (2870d977-4dd0-4520-be5c-8a974d078c1c): created successfully Sep 17 18:22:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea274950-0468-4360-b049-ba410e7f328b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Flow 'volume_create_manager' (2e8d7395-a822-438f-b073-bc9801de877a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:22:15 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-e085729d-e5a4-4560-8ac8-13da4842368b tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Created volume successfully. Sep 17 18:22:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:22:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:22:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:22:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:22:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:22:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:22:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.146s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:22:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Acquiring lock "cinder-2870d977-4dd0-4520-be5c-8a974d078c1c-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:22:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Lock "cinder-2870d977-4dd0-4520-be5c-8a974d078c1c-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:22:18 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:22:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Acquiring lock "cinder-quobyte-2870d977-4dd0-4520-be5c-8a974d078c1c" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:22:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Lock "cinder-quobyte-2870d977-4dd0-4520-be5c-8a974d078c1c" acquired by "delete_volume" :: waited 0.014s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:22:18 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b887f37-8abd-4c94-8bf6-3069ab557af7]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:22:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2870d977-4dd0-4520-be5c-8a974d078c1c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2870d977-4dd0-4520-be5c-8a974d078c1c" returned: 0 in 0.473s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2870d977-4dd0-4520-be5c-8a974d078c1c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2870d977-4dd0-4520-be5c-8a974d078c1c" returned: 0 in 0.093s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Lock "cinder-quobyte-2870d977-4dd0-4520-be5c-8a974d078c1c" released by "delete_volume" :: held 0.743s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:22:19 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Created reservations ['f7dfa5b6-4436-4109-90a4-835cddc39ddd', '2ae5883c-45ec-43bb-a878-28845075f114', '254a49c5-1662-4ba9-afb4-6472c080cfbb', 'ae0a9b1c-3322-4ff2-8d93-2ccb714568c1'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:22:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:22:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:22:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:22:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:22:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:22:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.115s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:19 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:22:19 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Deleted volume successfully. Sep 17 18:22:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-69f01591-5a69-4afd-9aba-1bc3dd485151 tempest-VolumeQuotasNegativeTestJSON-1613771707 None] Lock "cinder-2870d977-4dd0-4520-be5c-8a974d078c1c-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:22:29 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=42,cinder:SELECT=23,cinder:INSERT=6,cinder:DELETE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:22:29 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=14,cinder:UPDATE=18,cinder:DELETE=4,cinder:INSERT=6 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:22:30 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Flow 'volume_create_manager' (8bd16b83-0cc5-42da-bb6c-12f2b703f909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c8db71-6883-45e0-b815-2c6ce820fea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c8db71-6883-45e0-b815-2c6ce820fea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2046952065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f12b0d-5dd7-499c-ba52-264ea4f1ce33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b5e92375914c679b8028f9d1d782de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:22:30Z,use_quota=True,user_id='e5931b18155d4523ab2fbffb886b94f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad120db6-3dcd-410c-8968-b23b1210eb71),volume_type_id=ad120db6-3dcd-410c-8968-b23b1210eb71)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd36904f-2cb2-4161-a5a7-337c923e021b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd36904f-2cb2-4161-a5a7-337c923e021b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f389c2-0ef6-4694-85b9-73ef239bb5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f389c2-0ef6-4694-85b9-73ef239bb5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f12b0d-5dd7-499c-ba52-264ea4f1ce33', 'volume_name': 'volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0346f822-17ef-49ae-befa-c730d8a9abf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0346f822-17ef-49ae-befa-c730d8a9abf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3b32f1-8250-4898-ae4d-e5afe842d29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:30 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Volume 40f12b0d-5dd7-499c-ba52-264ea4f1ce33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33', 'volume_size': 1} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2046952065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f12b0d-5dd7-499c-ba52-264ea4f1ce33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b5e92375914c679b8028f9d1d782de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:22:30Z,use_quota=True,user_id='e5931b18155d4523ab2fbffb886b94f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad120db6-3dcd-410c-8968-b23b1210eb71),volume_type_id=ad120db6-3dcd-410c-8968-b23b1210eb71)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Creating volume 40f12b0d-5dd7-499c-ba52-264ea4f1ce33 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:22:30 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:30 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=23, name=volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33 1073741824" returned: 0 in 0.352s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33" returned: 0 in 0.087s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] <== create_volume: return (516ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:22:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.529s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:22:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3b32f1-8250-4898-ae4d-e5afe842d29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec87443e-b90b-4bf8-aecd-d90c4aec3926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:22:31 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Volume volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33 (40f12b0d-5dd7-499c-ba52-264ea4f1ce33): created successfully Sep 17 18:22:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec87443e-b90b-4bf8-aecd-d90c4aec3926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:22:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Flow 'volume_create_manager' (8bd16b83-0cc5-42da-bb6c-12f2b703f909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:22:31 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-bc01a1f6-7dd9-4267-9f67-f1f0e1f4903a tempest-VolumeTypesAccessTest-1473048015 None] Created volume successfully. Sep 17 18:22:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Acquiring lock "cinder-40f12b0d-5dd7-499c-ba52-264ea4f1ce33-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:22:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Lock "cinder-40f12b0d-5dd7-499c-ba52-264ea4f1ce33-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:22:32 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:22:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Acquiring lock "cinder-quobyte-40f12b0d-5dd7-499c-ba52-264ea4f1ce33" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:22:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Lock "cinder-quobyte-40f12b0d-5dd7-499c-ba52-264ea4f1ce33" acquired by "delete_volume" :: waited 0.033s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:22:32 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acbda57-f141-42ca-8fdd-9e5cac2e25f3]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:22:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33" returned: 0 in 0.437s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-40f12b0d-5dd7-499c-ba52-264ea4f1ce33" returned: 0 in 0.090s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Lock "cinder-quobyte-40f12b0d-5dd7-499c-ba52-264ea4f1ce33" released by "delete_volume" :: held 0.683s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:22:33 devstack cinder-volume[83736]: WARNING cinder.quota [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-384746571 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-384746571, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:22:33 devstack cinder-volume[83736]: WARNING cinder.quota [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-384746571 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-384746571, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:22:33 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Created reservations ['9d438ba5-3e49-4463-b17b-d24a0d82dd33', '4d03f2d6-d1a5-40b1-9167-84cd705768cb', '374050cb-ac74-4c4e-a937-b4b08a778ff6', '2300cfe1-c714-4bc6-8434-26e4a906041f'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:22:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:22:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:22:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:22:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:22:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:22:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:22:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.093s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:22:34 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:22:34 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Deleted volume successfully. Sep 17 18:22:34 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d9e590d9-56fb-4e93-998a-4cae6bf90b0a tempest-VolumeTypesAccessTest-1473048015 None] Lock "cinder-40f12b0d-5dd7-499c-ba52-264ea4f1ce33-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:22:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-08a54e5a-821c-4a4f-a5d7-af3172c9add2 req-3383d39a-f407-4195-85af-7e2c11c6c1cb tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:22:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-08a54e5a-821c-4a4f-a5d7-af3172c9add2 req-3383d39a-f407-4195-85af-7e2c11c6c1cb tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:22:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-08a54e5a-821c-4a4f-a5d7-af3172c9add2 req-3383d39a-f407-4195-85af-7e2c11c6c1cb tempest-AttachVolumeShelveTestJSON-1264840312 None] Terminate volume connection completed successfully. Sep 17 18:22:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-08a54e5a-821c-4a4f-a5d7-af3172c9add2 req-3383d39a-f407-4195-85af-7e2c11c6c1cb tempest-AttachVolumeShelveTestJSON-1264840312 None] Deleting attachment 4f4a4504-17b6-4df7-b806-15be4833cfe5. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:22:43 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=6,cinder:UPDATE=15 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:22:45 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=5,cinder:SELECT=8,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:23:09 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Flow 'volume_create_manager' (17330f04-404a-4cc3-8115-f5818fa89cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749ee531-1aeb-4afa-a5d0-502102e7283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749ee531-1aeb-4afa-a5d0-502102e7283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2134942745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a09af-fbfc-4586-b8e1-dd10b2db48df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5a5092a5884c9983996f19d4634d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:09Z,use_quota=True,user_id='d06469d3afd143ecabe8f880186d6255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22aedb62-131c-42a3-901b-0d7db0442646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22aedb62-131c-42a3-901b-0d7db0442646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e99755-76e3-44ff-b67b-394be8e313d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e99755-76e3-44ff-b67b-394be8e313d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835a09af-fbfc-4586-b8e1-dd10b2db48df', 'volume_name': 'volume-835a09af-fbfc-4586-b8e1-dd10b2db48df', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37de808c-fc2f-4d71-863a-e15d205a0822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37de808c-fc2f-4d71-863a-e15d205a0822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c5ba83-a6cd-4d8a-83cb-d7e07abdd73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:09 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Volume 835a09af-fbfc-4586-b8e1-dd10b2db48df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835a09af-fbfc-4586-b8e1-dd10b2db48df', 'volume_size': 1} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2134942745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a09af-fbfc-4586-b8e1-dd10b2db48df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5a5092a5884c9983996f19d4634d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:09Z,use_quota=True,user_id='d06469d3afd143ecabe8f880186d6255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Creating volume 835a09af-fbfc-4586-b8e1-dd10b2db48df {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:23:09 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-835a09af-fbfc-4586-b8e1-dd10b2db48df 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:09 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=24, name=volume-835a09af-fbfc-4586-b8e1-dd10b2db48df, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-835a09af-fbfc-4586-b8e1-dd10b2db48df 1073741824" returned: 0 in 0.317s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-835a09af-fbfc-4586-b8e1-dd10b2db48df {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-835a09af-fbfc-4586-b8e1-dd10b2db48df" returned: 0 in 0.079s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] <== create_volume: return (512ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:23:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.526s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c5ba83-a6cd-4d8a-83cb-d7e07abdd73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835a09af-fbfc-4586-b8e1-dd10b2db48df', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b4b825-f818-48db-b763-c4a43d9fe55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:10 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Volume volume-835a09af-fbfc-4586-b8e1-dd10b2db48df (835a09af-fbfc-4586-b8e1-dd10b2db48df): created successfully Sep 17 18:23:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b4b825-f818-48db-b763-c4a43d9fe55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Flow 'volume_create_manager' (17330f04-404a-4cc3-8115-f5818fa89cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:23:10 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-af56d846-44dd-420e-9bd7-3745fffc76aa tempest-VolumesListAdminTestJSON-344728778 None] Created volume successfully. Sep 17 18:23:11 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Flow 'volume_create_manager' (f6ea5a6b-97fb-46f8-852a-988828361090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4157746b-ea66-4eb6-9c12-28ade275732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4157746b-ea66-4eb6-9c12-28ade275732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-748702324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffd2da4-6fe8-4421-9228-acaa38fe31c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5a5092a5884c9983996f19d4634d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:12Z,use_quota=True,user_id='d06469d3afd143ecabe8f880186d6255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49cfcef8-455b-4e82-8b5a-b6f5ec0ac67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49cfcef8-455b-4e82-8b5a-b6f5ec0ac67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c98245-a49e-4712-a7f8-88fd318b2448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c98245-a49e-4712-a7f8-88fd318b2448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ffd2da4-6fe8-4421-9228-acaa38fe31c7', 'volume_name': 'volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d328c4-c0a6-4fa0-a581-5ae7e6743aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d328c4-c0a6-4fa0-a581-5ae7e6743aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6661c4e8-dafb-463d-a95e-64e72fb9d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:11 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Volume 1ffd2da4-6fe8-4421-9228-acaa38fe31c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7', 'volume_size': 1} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-748702324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffd2da4-6fe8-4421-9228-acaa38fe31c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5a5092a5884c9983996f19d4634d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:12Z,use_quota=True,user_id='d06469d3afd143ecabe8f880186d6255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Creating volume 1ffd2da4-6fe8-4421-9228-acaa38fe31c7 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:23:11 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:23:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:12 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=25, name=volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:23:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7 1073741824" returned: 0 in 0.309s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7" returned: 0 in 0.080s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] <== create_volume: return (464ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:23:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.480s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6661c4e8-dafb-463d-a95e-64e72fb9d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426aae88-abb4-488d-baeb-f965a1ec51a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:12 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Volume volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7 (1ffd2da4-6fe8-4421-9228-acaa38fe31c7): created successfully Sep 17 18:23:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426aae88-abb4-488d-baeb-f965a1ec51a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Flow 'volume_create_manager' (f6ea5a6b-97fb-46f8-852a-988828361090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:23:12 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1bd0729e-349d-4c81-bd02-55709cf48b43 tempest-VolumesListAdminTestJSON-344728778 None] Created volume successfully. Sep 17 18:23:14 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Flow 'volume_create_manager' (09e0e846-91f2-4470-aceb-37232fa81c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1a7013-7355-40f3-9ce6-39510b70470b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1a7013-7355-40f3-9ce6-39510b70470b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1849330039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1d400d-4bdb-43f4-a5da-0feb6c52fd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5a5092a5884c9983996f19d4634d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:14Z,use_quota=True,user_id='d06469d3afd143ecabe8f880186d6255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad8d6f0-9566-4cb3-bfdc-703afc91d2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad8d6f0-9566-4cb3-bfdc-703afc91d2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331c80e5-9421-492a-923f-55d6b47cf548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331c80e5-9421-492a-923f-55d6b47cf548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1d400d-4bdb-43f4-a5da-0feb6c52fd88', 'volume_name': 'volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdab0dc-5a75-4e1b-8927-b6aa64d3908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdab0dc-5a75-4e1b-8927-b6aa64d3908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508f12b3-90bc-4478-9104-6580a828072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:14 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Volume 6b1d400d-4bdb-43f4-a5da-0feb6c52fd88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88', 'volume_size': 1} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1849330039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1d400d-4bdb-43f4-a5da-0feb6c52fd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5a5092a5884c9983996f19d4634d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:14Z,use_quota=True,user_id='d06469d3afd143ecabe8f880186d6255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Creating volume 6b1d400d-4bdb-43f4-a5da-0feb6c52fd88 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:23:14 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:14 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=26, name=volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88 1073741824" returned: 0 in 0.344s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88" returned: 0 in 0.105s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] <== create_volume: return (518ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:23:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.533s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508f12b3-90bc-4478-9104-6580a828072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c48e279-c50c-4a38-9e11-ea8226a2299d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:15 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Volume volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88 (6b1d400d-4bdb-43f4-a5da-0feb6c52fd88): created successfully Sep 17 18:23:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c48e279-c50c-4a38-9e11-ea8226a2299d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Flow 'volume_create_manager' (09e0e846-91f2-4470-aceb-37232fa81c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:23:15 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1c0c8b54-c3f0-4619-92d9-b582a0568d98 tempest-VolumesListAdminTestJSON-344728778 None] Created volume successfully. Sep 17 18:23:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:23:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 1.254s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:23:18 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:18 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:23:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Flow 'volume_create_manager' (6ef9145f-c466-4a62-81ab-b5dd40979d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:23:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efd9b11-e441-4361-b641-531e23778749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efd9b11-e441-4361-b641-531e23778749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56048dc-de38-4ca0-90c0-2712bc595bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da87b307689e4786884759e69af68ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:18Z,use_quota=True,user_id='61c3f882c8084cdabc1c789689159d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b934337a-7c53-4ba6-a658-7042c13fb9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b934337a-7c53-4ba6-a658-7042c13fb9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8033b0d7-d046-4a98-a3d6-8783b6655a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8033b0d7-d046-4a98-a3d6-8783b6655a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a56048dc-de38-4ca0-90c0-2712bc595bb6', 'volume_name': 'volume-a56048dc-de38-4ca0-90c0-2712bc595bb6', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3163b88d-a91e-4568-a436-0fb2156ee0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3163b88d-a91e-4568-a436-0fb2156ee0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1114534-39ac-4789-b0ce-68eb589396f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:19 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Volume a56048dc-de38-4ca0-90c0-2712bc595bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a56048dc-de38-4ca0-90c0-2712bc595bb6', 'volume_size': 1} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56048dc-de38-4ca0-90c0-2712bc595bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da87b307689e4786884759e69af68ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:18Z,use_quota=True,user_id='61c3f882c8084cdabc1c789689159d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Creating volume a56048dc-de38-4ca0-90c0-2712bc595bb6 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:23:19 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a56048dc-de38-4ca0-90c0-2712bc595bb6 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:19 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=27, name=volume-a56048dc-de38-4ca0-90c0-2712bc595bb6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a56048dc-de38-4ca0-90c0-2712bc595bb6 1073741824" returned: 0 in 0.426s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a56048dc-de38-4ca0-90c0-2712bc595bb6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a56048dc-de38-4ca0-90c0-2712bc595bb6" returned: 0 in 0.109s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] <== create_volume: return (609ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.623s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1114534-39ac-4789-b0ce-68eb589396f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56048dc-de38-4ca0-90c0-2712bc595bb6', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac802451-49b9-4823-b0f9-d0b1f315ac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:20 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Volume volume-a56048dc-de38-4ca0-90c0-2712bc595bb6 (a56048dc-de38-4ca0-90c0-2712bc595bb6): created successfully Sep 17 18:23:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac802451-49b9-4823-b0f9-d0b1f315ac1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Flow 'volume_create_manager' (6ef9145f-c466-4a62-81ab-b5dd40979d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:23:20 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ad45a1aa-8a77-4e2d-aba7-0be01fef9d1b tempest-VolumesListAdminTestJSON-2100413149 None] Created volume successfully. Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Acquiring lock "cinder-a56048dc-de38-4ca0-90c0-2712bc595bb6-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Lock "cinder-a56048dc-de38-4ca0-90c0-2712bc595bb6-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "cinder-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:23:21 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Acquiring lock "cinder-quobyte-a56048dc-de38-4ca0-90c0-2712bc595bb6" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Lock "cinder-quobyte-a56048dc-de38-4ca0-90c0-2712bc595bb6" acquired by "delete_volume" :: waited 0.024s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:23:21 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "cinder-quobyte-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-quobyte-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faca5d1-b7d4-42eb-a9f1-5d070675f1c6]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a56048dc-de38-4ca0-90c0-2712bc595bb6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1693fed-0a19-442f-a31a-77405db0049d]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:23:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:22 devstack quobyte-client[83739]: System call of process 89900 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:23:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a56048dc-de38-4ca0-90c0-2712bc595bb6" returned: 0 in 0.865s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a56048dc-de38-4ca0-90c0-2712bc595bb6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a56048dc-de38-4ca0-90c0-2712bc595bb6" returned: 0 in 0.232s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Lock "cinder-quobyte-a56048dc-de38-4ca0-90c0-2712bc595bb6" released by "delete_volume" :: held 1.415s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:23:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88" returned: 0 in 1.245s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88" returned: 0 in 0.543s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-quobyte-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88" released by "delete_volume" :: held 2.369s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:23:23 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Created reservations ['22e64753-87e5-4d99-8668-1dca8f41b096', '210cb3bc-fffe-48cb-9b16-80cd74c20e04', '29558183-c794-4953-a0fd-6b4321a52c48', '73e5691a-48fb-49f9-80e8-e882c0c2a42d'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:23:23 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Created reservations ['122a0d77-5a3f-4306-a908-6f2aade0f5b6', 'bcbb578e-b601-4478-ab91-4676c37da508', 'e8bd5794-7ff4-4da6-9cd9-496bd4aa4caa', '106a89c2-43f2-4640-9fad-eaa0ecfc7cbe'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.172s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:23:24 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Deleted volume successfully. Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1fb2bed-5412-453a-be31-294682a47e53 tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-6b1d400d-4bdb-43f4-a5da-0feb6c52fd88-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.370s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:24 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:23:25 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Deleted volume successfully. Sep 17 18:23:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "cinder-1ffd2da4-6fe8-4421-9228-acaa38fe31c7-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:23:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-1ffd2da4-6fe8-4421-9228-acaa38fe31c7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:23:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4bfe65c8-b51e-474a-9906-08111aeb05f7 tempest-VolumesListAdminTestJSON-2100413149 None] Lock "cinder-a56048dc-de38-4ca0-90c0-2712bc595bb6-delete_volume" released by "delete_volume" :: held 4.088s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:23:25 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "cinder-quobyte-1ffd2da4-6fe8-4421-9228-acaa38fe31c7" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:23:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-quobyte-1ffd2da4-6fe8-4421-9228-acaa38fe31c7" acquired by "delete_volume" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:23:25 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f471851-8490-40ee-9036-da83350357c7]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:23:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7" returned: 0 in 0.578s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1ffd2da4-6fe8-4421-9228-acaa38fe31c7" returned: 0 in 0.236s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-quobyte-1ffd2da4-6fe8-4421-9228-acaa38fe31c7" released by "delete_volume" :: held 1.178s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:23:27 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-270ac22c-f9dc-4c86-afd6-e299aeb3b05f req-c26aca3b-0706-4369-a357-66d34b3ff14d tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:27 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-270ac22c-f9dc-4c86-afd6-e299aeb3b05f req-c26aca3b-0706-4369-a357-66d34b3ff14d tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:27 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-270ac22c-f9dc-4c86-afd6-e299aeb3b05f req-c26aca3b-0706-4369-a357-66d34b3ff14d tempest-AttachVolumeNegativeTest-680660464 None] Terminate volume connection completed successfully. Sep 17 18:23:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-270ac22c-f9dc-4c86-afd6-e299aeb3b05f req-c26aca3b-0706-4369-a357-66d34b3ff14d tempest-AttachVolumeNegativeTest-680660464 None] Deleting attachment 0e580c8a-ef3f-44a1-8de8-4570a5a98fd2. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:23:27 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Created reservations ['146ef96e-0e7a-4209-b12e-de26374ba4b2', 'c591a8dd-d4a8-4e27-b1ea-62ef7eca207e', 'c50df50a-f45b-490a-b221-3f0c0846a867', 'dc9e1d20-88ca-4def-a4bf-b47c30472d52'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:23:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.238s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:27 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:23:28 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Deleted volume successfully. Sep 17 18:23:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33541223-135a-420e-86f4-fbeb10cb03a2 tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-1ffd2da4-6fe8-4421-9228-acaa38fe31c7-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:23:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "cinder-835a09af-fbfc-4586-b8e1-dd10b2db48df-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:23:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-835a09af-fbfc-4586-b8e1-dd10b2db48df-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:23:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "cinder-quobyte-835a09af-fbfc-4586-b8e1-dd10b2db48df" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:23:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-quobyte-835a09af-fbfc-4586-b8e1-dd10b2db48df" acquired by "delete_volume" :: waited 0.031s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:23:29 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[675576ab-da33-451a-bfcd-2a795b1a7b0b]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:23:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-835a09af-fbfc-4586-b8e1-dd10b2db48df {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-835a09af-fbfc-4586-b8e1-dd10b2db48df" returned: 0 in 0.557s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-835a09af-fbfc-4586-b8e1-dd10b2db48df {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-835a09af-fbfc-4586-b8e1-dd10b2db48df" returned: 0 in 0.332s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-quobyte-835a09af-fbfc-4586-b8e1-dd10b2db48df" released by "delete_volume" :: held 1.279s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:23:30 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Created reservations ['f9364ba2-8997-472a-b7c0-bdbc11db9839', 'b5cda2b3-77a7-405a-9f39-8b57f3c8689d', '8adae568-531a-4db2-b951-6b9747c5426e', 'be3c8e7d-602a-4001-8b75-5761523b4787'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:23:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.288s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:31 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:23:32 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Deleted volume successfully. Sep 17 18:23:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-424fe5ee-daf2-4207-ac0a-f036eddfad9e tempest-VolumesListAdminTestJSON-344728778 None] Lock "cinder-835a09af-fbfc-4586-b8e1-dd10b2db48df-delete_volume" released by "delete_volume" :: held 4.263s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:23:41 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=30,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:23:42 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Flow 'volume_create_manager' (d2f71fe0-b0d5-4eef-9245-e9f56a231a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e81f3e-65c8-4cf5-a576-fa9facd1af54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e81f3e-65c8-4cf5-a576-fa9facd1af54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1007748403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc704657-eee7-4319-a4bc-5d8685a7b9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f1bd0396e44da884a903a969c24211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:42Z,use_quota=True,user_id='bd42465495fa4f3f88e6c77e01595a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2402f7e-acc0-447c-ac68-3a2072f89c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2402f7e-acc0-447c-ac68-3a2072f89c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a604ba-6cb5-4426-9814-7727070b19af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a604ba-6cb5-4426-9814-7727070b19af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc704657-eee7-4319-a4bc-5d8685a7b9bb', 'volume_name': 'volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c71f83-0be2-4bf9-ba60-922f0f346f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c71f83-0be2-4bf9-ba60-922f0f346f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7f9386-8b41-4ab6-87f3-9b1e8dff7e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:42 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Volume fc704657-eee7-4319-a4bc-5d8685a7b9bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb', 'volume_size': 1} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1007748403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc704657-eee7-4319-a4bc-5d8685a7b9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f1bd0396e44da884a903a969c24211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:42Z,use_quota=True,user_id='bd42465495fa4f3f88e6c77e01595a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Creating volume fc704657-eee7-4319-a4bc-5d8685a7b9bb {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:23:42 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:42 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=28, name=volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb 1073741824" returned: 0 in 0.447s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb" returned: 0 in 0.191s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] <== create_volume: return (808ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:23:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7f9386-8b41-4ab6-87f3-9b1e8dff7e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a35461e-214a-47ba-96fe-db46c708e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:43 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Volume volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb (fc704657-eee7-4319-a4bc-5d8685a7b9bb): created successfully Sep 17 18:23:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a35461e-214a-47ba-96fe-db46c708e5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Flow 'volume_create_manager' (d2f71fe0-b0d5-4eef-9245-e9f56a231a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:23:43 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-8a1fff36-2810-4e72-9e1b-897b53af66b3 tempest-AbsoluteLimitsTests-722296981 None] Created volume successfully. Sep 17 18:23:44 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Acquiring lock "cinder-fc704657-eee7-4319-a4bc-5d8685a7b9bb-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:23:44 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Lock "cinder-fc704657-eee7-4319-a4bc-5d8685a7b9bb-delete_volume" acquired by "delete_volume" :: waited 0.142s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:23:44 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:44 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Acquiring lock "cinder-quobyte-fc704657-eee7-4319-a4bc-5d8685a7b9bb" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:23:44 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Lock "cinder-quobyte-fc704657-eee7-4319-a4bc-5d8685a7b9bb" acquired by "delete_volume" :: waited 0.016s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:23:45 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ef9715-f3d6-4afb-8247-73459f8c968c]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:23:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:45 devstack quobyte-client[83739]: System call of process 89968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:23:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb" returned: 0 in 0.544s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fc704657-eee7-4319-a4bc-5d8685a7b9bb" returned: 0 in 0.157s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Lock "cinder-quobyte-fc704657-eee7-4319-a4bc-5d8685a7b9bb" released by "delete_volume" :: held 0.956s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:23:46 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Created reservations ['ad31cfda-962b-42e8-829e-102c896fcb5d', '48611ed5-a38f-42c7-8307-6fa696845c9a', '3c98e505-08d7-4f87-a9c4-571753131a7e', '98384665-cb08-41c0-9088-158936b436be'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:23:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.114s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:46 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:23:46 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Deleted volume successfully. Sep 17 18:23:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75be7e8f-9e91-4448-aed9-52da08ab60aa tempest-AbsoluteLimitsTests-722296981 None] Lock "cinder-fc704657-eee7-4319-a4bc-5d8685a7b9bb-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:23:56 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=53,cinder:SELECT=26,cinder:DELETE=6,cinder:INSERT=12 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:23:56 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:23:57 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:23:57 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:23:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Flow 'volume_create_manager' (4f718e2e-fe28-40c4-bbc0-577d06c56e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:23:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f994d8-07ad-4f2e-97df-eb40d419c2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f994d8-07ad-4f2e-97df-eb40d419c2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1675608451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3015adf4-1dc3-436f-9b2b-6258d26a8b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5911a58d6946eb82f347a732a2bc2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:57Z,use_quota=True,user_id='bdb0f9a34a44459790b0e52145b1c21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd3717c-7da4-4e79-b283-9ac91f856d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd3717c-7da4-4e79-b283-9ac91f856d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657f1cf4-c5cc-4019-83a2-ca1db72a4684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657f1cf4-c5cc-4019-83a2-ca1db72a4684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3015adf4-1dc3-436f-9b2b-6258d26a8b05', 'volume_name': 'volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f56160-2f70-4bf2-a4b3-201358076faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f56160-2f70-4bf2-a4b3-201358076faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69839a4c-1b1d-44b6-a025-c82ade8208a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:23:58 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Volume 3015adf4-1dc3-436f-9b2b-6258d26a8b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05', 'volume_size': 1} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1675608451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3015adf4-1dc3-436f-9b2b-6258d26a8b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5911a58d6946eb82f347a732a2bc2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:23:57Z,use_quota=True,user_id='bdb0f9a34a44459790b0e52145b1c21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Creating volume 3015adf4-1dc3-436f-9b2b-6258d26a8b05 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:23:58 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:23:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:58 devstack quobyte-client[83739]: System call of process 90038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:23:58 devstack quobyte-client[83739]: System call of process 90038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:23:58 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=29, name=volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:23:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05 1073741824" returned: 0 in 0.686s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:23:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05" returned: 0 in 0.273s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:23:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] <== create_volume: return (1136ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:23:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:23:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69839a4c-1b1d-44b6-a025-c82ade8208a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:23:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a36f60-2a55-4393-99bc-ee1d3785547e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:00 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Volume volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05 (3015adf4-1dc3-436f-9b2b-6258d26a8b05): created successfully Sep 17 18:24:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a36f60-2a55-4393-99bc-ee1d3785547e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Flow 'volume_create_manager' (4f718e2e-fe28-40c4-bbc0-577d06c56e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:24:00 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7cb088ff-3ad6-4774-8324-c218efd372d6 tempest-VolumesTransfersTest-19107513 None] Created volume successfully. Sep 17 18:24:01 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ac51d8fd-84c5-4aa4-84c2-1b7975af1b64 tempest-VolumesTransfersTest-1065773317 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:24:01 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ac51d8fd-84c5-4aa4-84c2-1b7975af1b64 tempest-VolumesTransfersTest-1065773317 None] Transfer volume completed successfully. Sep 17 18:24:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Acquiring lock "cinder-3015adf4-1dc3-436f-9b2b-6258d26a8b05-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:24:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Lock "cinder-3015adf4-1dc3-436f-9b2b-6258d26a8b05-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:24:03 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:24:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Acquiring lock "cinder-quobyte-3015adf4-1dc3-436f-9b2b-6258d26a8b05" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:24:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Lock "cinder-quobyte-3015adf4-1dc3-436f-9b2b-6258d26a8b05" acquired by "delete_volume" :: waited 0.019s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:24:03 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba12918c-832a-4e9e-8390-1950491f22ce]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:24:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05" returned: 0 in 0.554s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3015adf4-1dc3-436f-9b2b-6258d26a8b05" returned: 0 in 0.096s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Lock "cinder-quobyte-3015adf4-1dc3-436f-9b2b-6258d26a8b05" released by "delete_volume" :: held 0.840s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:24:04 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Created reservations ['46141243-be7f-4dd8-9432-706c87c96184', 'a4038293-1903-4977-a5a3-d65ae0b8c28f', 'dd3fabb7-a8c0-449c-8d8b-7dd4b679603c', '181f4a4d-440c-4856-b264-34b3a49bb17a'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:24:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:24:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:24:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.104s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:04 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:24:04 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Deleted volume successfully. Sep 17 18:24:04 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2f1bdb14-07a7-4e2e-b109-853231cbe735 tempest-VolumesTransfersTest-294305444 None] Lock "cinder-3015adf4-1dc3-436f-9b2b-6258d26a8b05-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:24:05 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:24:05 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:24:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Flow 'volume_create_manager' (097d374c-26b7-43c4-bc04-a43e9a36b29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:24:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ff9f0-694f-4401-84d7-96fe505e604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ff9f0-694f-4401-84d7-96fe505e604b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-805808538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b72853-3bac-44e4-a48e-00a69b36f961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5911a58d6946eb82f347a732a2bc2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:24:06Z,use_quota=True,user_id='bdb0f9a34a44459790b0e52145b1c21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06b4d6f-c5ed-4c10-a220-75aa19369e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06b4d6f-c5ed-4c10-a220-75aa19369e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2939de17-d868-48db-ac9b-0b0e267213a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2939de17-d868-48db-ac9b-0b0e267213a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b72853-3bac-44e4-a48e-00a69b36f961', 'volume_name': 'volume-45b72853-3bac-44e4-a48e-00a69b36f961', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadfb5e2-f3b8-46ba-be72-9a495dd55f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadfb5e2-f3b8-46ba-be72-9a495dd55f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0629d7-fcc7-4fc1-890c-0952777601d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:06 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Volume 45b72853-3bac-44e4-a48e-00a69b36f961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b72853-3bac-44e4-a48e-00a69b36f961', 'volume_size': 1} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-805808538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b72853-3bac-44e4-a48e-00a69b36f961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5911a58d6946eb82f347a732a2bc2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:24:06Z,use_quota=True,user_id='bdb0f9a34a44459790b0e52145b1c21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Creating volume 45b72853-3bac-44e4-a48e-00a69b36f961 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:24:06 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-45b72853-3bac-44e4-a48e-00a69b36f961 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:06 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=30, name=volume-45b72853-3bac-44e4-a48e-00a69b36f961, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-45b72853-3bac-44e4-a48e-00a69b36f961 1073741824" returned: 0 in 0.364s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-45b72853-3bac-44e4-a48e-00a69b36f961 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-45b72853-3bac-44e4-a48e-00a69b36f961" returned: 0 in 0.095s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] <== create_volume: return (560ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.573s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0629d7-fcc7-4fc1-890c-0952777601d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b72853-3bac-44e4-a48e-00a69b36f961', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec5c4ea-33c2-4d43-8223-864585772d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:06 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Volume volume-45b72853-3bac-44e4-a48e-00a69b36f961 (45b72853-3bac-44e4-a48e-00a69b36f961): created successfully Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec5c4ea-33c2-4d43-8223-864585772d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Flow 'volume_create_manager' (097d374c-26b7-43c4-bc04-a43e9a36b29a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:24:07 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1054b558-4176-4c45-8aaf-40667c8644d8 tempest-VolumesTransfersTest-19107513 None] Created volume successfully. Sep 17 18:24:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Acquiring lock "cinder-45b72853-3bac-44e4-a48e-00a69b36f961-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:24:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Lock "cinder-45b72853-3bac-44e4-a48e-00a69b36f961-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:24:09 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:24:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Acquiring lock "cinder-quobyte-45b72853-3bac-44e4-a48e-00a69b36f961" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:24:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Lock "cinder-quobyte-45b72853-3bac-44e4-a48e-00a69b36f961" acquired by "delete_volume" :: waited 0.029s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:24:10 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da0c0da-5763-48ea-a3b1-305fcc93c0b6]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:24:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-45b72853-3bac-44e4-a48e-00a69b36f961 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:11 devstack quobyte-client[83739]: System call of process 90133 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:24:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-45b72853-3bac-44e4-a48e-00a69b36f961" returned: 0 in 1.260s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-45b72853-3bac-44e4-a48e-00a69b36f961 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-45b72853-3bac-44e4-a48e-00a69b36f961" returned: 0 in 0.203s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:11 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Lock "cinder-quobyte-45b72853-3bac-44e4-a48e-00a69b36f961" released by "delete_volume" :: held 1.795s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:24:12 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Created reservations ['66eceda0-4688-4ab9-a6f1-a915224d6fe2', 'e474eb96-d1a0-4891-9c53-0c4fbc79a761', '1465c364-53f5-418f-8e23-5e9ff0b875b8', 'dd3c92cd-ec8a-4664-ba43-04c54be31c92'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:24:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:24:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:24:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.177s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:13 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:24:13 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Deleted volume successfully. Sep 17 18:24:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cf034dd9-6ceb-4a0b-a4e4-65ee51abb716 tempest-VolumesTransfersTest-294305444 None] Lock "cinder-45b72853-3bac-44e4-a48e-00a69b36f961-delete_volume" released by "delete_volume" :: held 4.047s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:24:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:24:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:24:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:24:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.299s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:24:22 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=12,cinder:UPDATE=16,cinder:DELETE=3,cinder:INSERT=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:24:23 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=24,cinder:SELECT=13,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:24:24 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:24:24 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:24:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Flow 'volume_create_manager' (4ec9d77c-637c-46fa-a165-577a22770633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:24:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b61c2a9-7baf-4444-98e6-d68fd55cf34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b61c2a9-7baf-4444-98e6-d68fd55cf34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1576945121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bcf448e-975f-4abc-be06-505a8a80a737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d30281b1a924b9fa5ac2ab13b05d4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:24:25Z,use_quota=True,user_id='3e834e8fb0aa40bd891023ddeecc57ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1f3e57-31e3-48b8-b5e6-a247b8342fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1f3e57-31e3-48b8-b5e6-a247b8342fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7176cc7-8ffc-45f1-90b4-9426bd02a2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7176cc7-8ffc-45f1-90b4-9426bd02a2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bcf448e-975f-4abc-be06-505a8a80a737', 'volume_name': 'volume-5bcf448e-975f-4abc-be06-505a8a80a737', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52294890-caf7-496c-b08c-c26e072892e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52294890-caf7-496c-b08c-c26e072892e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138f93d2-2379-4f7f-8f50-f9a93565facb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:25 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Volume 5bcf448e-975f-4abc-be06-505a8a80a737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bcf448e-975f-4abc-be06-505a8a80a737', 'volume_size': 1} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1576945121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bcf448e-975f-4abc-be06-505a8a80a737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d30281b1a924b9fa5ac2ab13b05d4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:24:25Z,use_quota=True,user_id='3e834e8fb0aa40bd891023ddeecc57ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Creating volume 5bcf448e-975f-4abc-be06-505a8a80a737 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:24:25 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5bcf448e-975f-4abc-be06-505a8a80a737 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:25 devstack quobyte-client[83739]: System call of process 90179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:24:25 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=31, name=volume-5bcf448e-975f-4abc-be06-505a8a80a737, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5bcf448e-975f-4abc-be06-505a8a80a737 1073741824" returned: 0 in 0.400s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5bcf448e-975f-4abc-be06-505a8a80a737 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5bcf448e-975f-4abc-be06-505a8a80a737" returned: 0 in 0.199s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] <== create_volume: return (688ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138f93d2-2379-4f7f-8f50-f9a93565facb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bcf448e-975f-4abc-be06-505a8a80a737', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5abbb30-25f7-4114-a28e-eb0151999663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:26 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Volume volume-5bcf448e-975f-4abc-be06-505a8a80a737 (5bcf448e-975f-4abc-be06-505a8a80a737): created successfully Sep 17 18:24:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5abbb30-25f7-4114-a28e-eb0151999663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Flow 'volume_create_manager' (4ec9d77c-637c-46fa-a165-577a22770633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:24:26 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-65113b31-d5c9-47d1-83b4-8efe5d712fdd tempest-VolumesTransfersV355Test-1100090118 None] Created volume successfully. Sep 17 18:24:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-88a2a881-a766-4cd9-8d5a-082ffb051f08 tempest-VolumesTransfersV355Test-831003413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:24:28 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-88a2a881-a766-4cd9-8d5a-082ffb051f08 tempest-VolumesTransfersV355Test-831003413 None] Transfer volume completed successfully. Sep 17 18:24:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Acquiring lock "cinder-5bcf448e-975f-4abc-be06-505a8a80a737-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:24:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Lock "cinder-5bcf448e-975f-4abc-be06-505a8a80a737-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:24:30 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:24:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Acquiring lock "cinder-quobyte-5bcf448e-975f-4abc-be06-505a8a80a737" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:24:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Lock "cinder-quobyte-5bcf448e-975f-4abc-be06-505a8a80a737" acquired by "delete_volume" :: waited 0.020s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:24:30 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4231c7fa-b5ef-4839-b861-eb4d23ea320b]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:24:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5bcf448e-975f-4abc-be06-505a8a80a737 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5bcf448e-975f-4abc-be06-505a8a80a737" returned: 0 in 0.506s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5bcf448e-975f-4abc-be06-505a8a80a737 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5bcf448e-975f-4abc-be06-505a8a80a737" returned: 0 in 0.247s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Lock "cinder-quobyte-5bcf448e-975f-4abc-be06-505a8a80a737" released by "delete_volume" :: held 1.022s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:24:31 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Created reservations ['2b0867e3-1735-4a31-84c6-16d3866002d0', 'c6ee9d02-5392-46f0-8c42-7de77c955af4', 'cc983e93-610c-4e51-801c-006cfb8ca29c', '9563c47b-0a78-4a09-a28b-a1640ad17418'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:24:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:24:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:24:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.412s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:32 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:24:32 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Deleted volume successfully. Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6868e49a-78f5-4d50-8cbd-a2bdbb123256 tempest-VolumesTransfersV355Test-76067406 None] Lock "cinder-5bcf448e-975f-4abc-be06-505a8a80a737-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:24:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Flow 'volume_create_manager' (edca284a-0b8d-4861-90b3-336011157aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f400f4e4-ce54-40cb-8d6b-59587038b819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f400f4e4-ce54-40cb-8d6b-59587038b819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1130880265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3736205-d14c-454e-a413-a184d4282d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd17f886f794c6f9ca2083d1a15cd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:24:33Z,use_quota=True,user_id='3843de3dd8654fc3ad77b595fc56ee0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1722f019-0bb2-4453-82e9-7a7251183a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1722f019-0bb2-4453-82e9-7a7251183a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a0c1f4-95ef-4b3a-ac24-a32706137740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a0c1f4-95ef-4b3a-ac24-a32706137740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3736205-d14c-454e-a413-a184d4282d8c', 'volume_name': 'volume-c3736205-d14c-454e-a413-a184d4282d8c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9643fe14-96c6-44e3-8803-591f9901a53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9643fe14-96c6-44e3-8803-591f9901a53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b80168-d720-45fe-a8ab-79e4132a59f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:33 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume c3736205-d14c-454e-a413-a184d4282d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3736205-d14c-454e-a413-a184d4282d8c', 'volume_size': 1} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1130880265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3736205-d14c-454e-a413-a184d4282d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd17f886f794c6f9ca2083d1a15cd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:24:33Z,use_quota=True,user_id='3843de3dd8654fc3ad77b595fc56ee0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Creating volume c3736205-d14c-454e-a413-a184d4282d8c {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:24:33 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c3736205-d14c-454e-a413-a184d4282d8c 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:33 devstack quobyte-client[83739]: System call of process 90191 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:24:33 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=32, name=volume-c3736205-d14c-454e-a413-a184d4282d8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:24:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:24:33 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Flow 'volume_create_manager' (b0c430aa-bb2d-4640-9699-22a979c8524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f6db0e-99e7-42ae-877a-2fa21591fd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f6db0e-99e7-42ae-877a-2fa21591fd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-521452814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93df6be2-9b05-4f75-84ea-dfd338f01d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d30281b1a924b9fa5ac2ab13b05d4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:24:33Z,use_quota=True,user_id='3e834e8fb0aa40bd891023ddeecc57ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cdb2a2-205b-4cb3-9c60-dec053ebd50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cdb2a2-205b-4cb3-9c60-dec053ebd50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b0cb0e-3d78-4360-8793-f295840c8e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b0cb0e-3d78-4360-8793-f295840c8e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93df6be2-9b05-4f75-84ea-dfd338f01d22', 'volume_name': 'volume-93df6be2-9b05-4f75-84ea-dfd338f01d22', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9981418-adda-4700-8f7e-07418d39cc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9981418-adda-4700-8f7e-07418d39cc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0ac825-07cb-4095-8433-fd0c2b65c493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:34 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Volume 93df6be2-9b05-4f75-84ea-dfd338f01d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93df6be2-9b05-4f75-84ea-dfd338f01d22', 'volume_size': 1} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c3736205-d14c-454e-a413-a184d4282d8c 1073741824" returned: 0 in 0.811s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c3736205-d14c-454e-a413-a184d4282d8c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c3736205-d14c-454e-a413-a184d4282d8c" returned: 0 in 0.235s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] <== create_volume: return (1084ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-521452814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93df6be2-9b05-4f75-84ea-dfd338f01d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d30281b1a924b9fa5ac2ab13b05d4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:24:33Z,use_quota=True,user_id='3e834e8fb0aa40bd891023ddeecc57ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Creating volume 93df6be2-9b05-4f75-84ea-dfd338f01d22 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:24:34 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:24:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93df6be2-9b05-4f75-84ea-dfd338f01d22 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:35 devstack quobyte-client[83739]: System call of process 90196 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:24:35 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=33, name=volume-93df6be2-9b05-4f75-84ea-dfd338f01d22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:24:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b80168-d720-45fe-a8ab-79e4132a59f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3736205-d14c-454e-a413-a184d4282d8c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1fb039-3989-4c1c-a4ef-d5dc00cb4bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:35 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume volume-c3736205-d14c-454e-a413-a184d4282d8c (c3736205-d14c-454e-a413-a184d4282d8c): created successfully Sep 17 18:24:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1fb039-3989-4c1c-a4ef-d5dc00cb4bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Flow 'volume_create_manager' (edca284a-0b8d-4861-90b3-336011157aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:24:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-0a3b90f5-91a3-4e74-8fca-e763b99aea91 tempest-AttachVolumeShelveTestJSON-1264840312 None] Created volume successfully. Sep 17 18:24:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93df6be2-9b05-4f75-84ea-dfd338f01d22 1073741824" returned: 0 in 0.785s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93df6be2-9b05-4f75-84ea-dfd338f01d22 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93df6be2-9b05-4f75-84ea-dfd338f01d22" returned: 0 in 0.159s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] <== create_volume: return (1054ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:24:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0ac825-07cb-4095-8433-fd0c2b65c493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93df6be2-9b05-4f75-84ea-dfd338f01d22', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8fd4e5-9bda-4090-af68-d1975c67eff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:36 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Volume volume-93df6be2-9b05-4f75-84ea-dfd338f01d22 (93df6be2-9b05-4f75-84ea-dfd338f01d22): created successfully Sep 17 18:24:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8fd4e5-9bda-4090-af68-d1975c67eff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Flow 'volume_create_manager' (b0c430aa-bb2d-4640-9699-22a979c8524b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:24:36 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d682295a-9289-4edd-81cd-a6731369b227 tempest-VolumesTransfersV355Test-1100090118 None] Created volume successfully. Sep 17 18:24:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Acquiring lock "cinder-93df6be2-9b05-4f75-84ea-dfd338f01d22-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:24:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Lock "cinder-93df6be2-9b05-4f75-84ea-dfd338f01d22-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:24:37 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:24:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Acquiring lock "cinder-quobyte-93df6be2-9b05-4f75-84ea-dfd338f01d22" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:24:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Lock "cinder-quobyte-93df6be2-9b05-4f75-84ea-dfd338f01d22" acquired by "delete_volume" :: waited 0.030s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:24:37 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb091486-f72e-4712-82a0-421a081c2cd9]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:24:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93df6be2-9b05-4f75-84ea-dfd338f01d22 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:38 devstack quobyte-client[83739]: System call of process 90204 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:24:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93df6be2-9b05-4f75-84ea-dfd338f01d22" returned: 0 in 0.880s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93df6be2-9b05-4f75-84ea-dfd338f01d22 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93df6be2-9b05-4f75-84ea-dfd338f01d22" returned: 0 in 0.382s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Lock "cinder-quobyte-93df6be2-9b05-4f75-84ea-dfd338f01d22" released by "delete_volume" :: held 1.639s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:24:40 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Created reservations ['885ea1ca-cf46-4ac6-842a-ab7c3a758877', '8d6032d5-d41a-430a-853f-0afe63cb46b9', '08004a23-686b-439f-8c97-73ee20e6e4c5', 'befab34a-98a8-494c-8e92-b4f48babd95f'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:24:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:24:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:24:40 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:24:40 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:24:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:24:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.168s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:41 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:24:41 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Deleted volume successfully. Sep 17 18:24:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d95e9e51-2b71-4b1b-8226-e4f9ffb209b0 tempest-VolumesTransfersV355Test-76067406 None] Lock "cinder-93df6be2-9b05-4f75-84ea-dfd338f01d22-delete_volume" released by "delete_volume" :: held 4.345s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:24:50 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=18,cinder:SELECT=8,cinder:DELETE=2,cinder:INSERT=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:24:51 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=19,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=7 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:24:54 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Flow 'volume_create_manager' (c831824d-adbb-40f6-9db6-238d5d8c9c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af07a3ef-0091-4efe-8cc1-55dd40203499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af07a3ef-0091-4efe-8cc1-55dd40203499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-275832754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a10e97-22d9-423e-a9ce-018ddcdf42fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74090eacb8c343c89f6f12016165c106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:24:54Z,use_quota=True,user_id='65b0e0eb4755465d800ed1396efc67c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7131ad-ab79-4ac3-8146-390c01f94e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7131ad-ab79-4ac3-8146-390c01f94e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1774b91-bc27-47af-945e-87fa68ee604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.image.glance [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Creating Keystone auth plugin from conf {{(pid=83736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1774b91-bc27-47af-945e-87fa68ee604e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '88a10e97-22d9-423e-a9ce-018ddcdf42fe', 'volume_name': 'volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fd2011-c438-4805-b51f-4aafee2b2961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fd2011-c438-4805-b51f-4aafee2b2961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9e8ee9-3376-4186-b0ea-a93dea06d874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:24:54 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Volume 88a10e97-22d9-423e-a9ce-018ddcdf42fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 18:24:54 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Cloning 88a10e97-22d9-423e-a9ce-018ddcdf42fe from image 9006947d-67cc-459e-820f-320733203bdb at location (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]). {{(pid=83736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 17 18:24:55 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 18:24:55 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Image download 20.69 MB at 20.69 MB/s Sep 17 18:24:55 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f053925d-7f75-4369-98f0-c03d49951162]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:24:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:56 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD Sep 17 18:24:56 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:24:58 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Sep 17 18:24:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD" returned: 0 in 3.060s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:24:58 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Temporary image 9006947d-67cc-459e-820f-320733203bdb is fetched for user 65b0e0eb4755465d800ed1396efc67c9. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 18:24:59 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e187fd6f-e541-4523-a04f-46e59ef9dcf2]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:24:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:24:59 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD Sep 17 18:24:59 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:25:00 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-ae8b4e40-8605-46a5-a06b-82885234338b req-248a4578-427a-4404-b67e-3a9dcf8b2c93 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:00 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-ae8b4e40-8605-46a5-a06b-82885234338b req-248a4578-427a-4404-b67e-3a9dcf8b2c93 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-ae8b4e40-8605-46a5-a06b-82885234338b req-248a4578-427a-4404-b67e-3a9dcf8b2c93 tempest-AttachVolumeShelveTestJSON-1264840312 None] No connector for attachment e8cfb3f4-fe37-4de9-af70-b144b0da5b3c; skipping storage backend terminate_connection call. {{(pid=83736) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 17 18:25:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-ae8b4e40-8605-46a5-a06b-82885234338b req-248a4578-427a-4404-b67e-3a9dcf8b2c93 tempest-AttachVolumeShelveTestJSON-1264840312 None] Deleting attachment e8cfb3f4-fe37-4de9-af70-b144b0da5b3c. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:25:02 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD" returned: 0 in 3.118s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-275832754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a10e97-22d9-423e-a9ce-018ddcdf42fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74090eacb8c343c89f6f12016165c106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:24:54Z,use_quota=True,user_id='65b0e0eb4755465d800ed1396efc67c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Creating volume 88a10e97-22d9-423e-a9ce-018ddcdf42fe {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:25:02 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:02 devstack quobyte-client[83739]: System call of process 90348 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:25:02 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=34, name=volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:25:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe 1073741824" returned: 0 in 0.498s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe" returned: 0 in 0.136s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:03 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] <== create_volume: return (928ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:25:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:03 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Attempting download of 9006947d-67cc-459e-820f-320733203bdb ((None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}])) to volume 88a10e97-22d9-423e-a9ce-018ddcdf42fe. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 18:25:03 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dc4bda-668d-4c30-8f0f-72a5fc1597da]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_gxxn2yev {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_gxxn2yev" returned: 0 in 0.394s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_gxxn2yev {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_gxxn2yev" returned: 1 in 0.874s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_gxxn2yev' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:25:04 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e224c-99a0-400d-ba86-4f322a6fcc93]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:05 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] 9006947d-67cc-459e-820f-320733203bdb was qcow2, converting to raw {{(pid=83736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 18:25:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:06 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=34, name=volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:25:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe" returned: 0 in 1.469s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:07 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_dxgnhkbgdevstack@QuobyteHD, size 112.00 MB, duration 1.50 sec, destination /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:25:07 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Converted 112.00 MB image at 74.76 MB/s Sep 17 18:25:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe 1G" returned: 0 in 0.163s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:07 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e65e44-8e9b-4f63-bfeb-c95356d6eee4]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe" returned: 0 in 0.440s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe" returned: 1 in 0.410s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:25:08 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Downloaded image 9006947d-67cc-459e-820f-320733203bdb ((None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}])) to volume 88a10e97-22d9-423e-a9ce-018ddcdf42fe successfully. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 18:25:08 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Temporary image 9006947d-67cc-459e-820f-320733203bdb for user 65b0e0eb4755465d800ed1396efc67c9 is deleted. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 18:25:08 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Marking volume 88a10e97-22d9-423e-a9ce-018ddcdf42fe as bootable. {{(pid=83736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 18:25:08 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Copying metadata from image 9006947d-67cc-459e-820f-320733203bdb to 88a10e97-22d9-423e-a9ce-018ddcdf42fe. {{(pid=83736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 18:25:08 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Creating volume glance metadata for volume 88a10e97-22d9-423e-a9ce-018ddcdf42fe backed by image 9006947d-67cc-459e-820f-320733203bdb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 18:25:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9e8ee9-3376-4186-b0ea-a93dea06d874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5102ad-7af2-4a65-8e0d-215663bc983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:08 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Volume volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe (88a10e97-22d9-423e-a9ce-018ddcdf42fe): created successfully Sep 17 18:25:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5102ad-7af2-4a65-8e0d-215663bc983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Flow 'volume_create_manager' (c831824d-adbb-40f6-9db6-238d5d8c9c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:25:09 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-defbf1f7-41fc-4fcb-8d59-6dc575c36103 tempest-VolumesExtendTest-1744860348 None] Created volume successfully. Sep 17 18:25:10 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:10 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c4e9ae-bec2-473a-9ea7-df8eed6ad66e]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe" returned: 0 in 0.645s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe" returned: 1 in 0.402s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:25:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe 2G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:11 devstack quobyte-client[83739]: System call of process 90540 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:25:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe 2G" returned: 0 in 0.157s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.428s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:12 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2cb59aad-f467-4cb7-a98c-922ca95a8d05 tempest-VolumesExtendTest-1744860348 None] Extend volume completed successfully. Sep 17 18:25:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Acquiring lock "cinder-88a10e97-22d9-423e-a9ce-018ddcdf42fe-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Lock "cinder-88a10e97-22d9-423e-a9ce-018ddcdf42fe-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Acquiring lock "cinder-quobyte-88a10e97-22d9-423e-a9ce-018ddcdf42fe" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Lock "cinder-quobyte-88a10e97-22d9-423e-a9ce-018ddcdf42fe" acquired by "delete_volume" :: waited 0.020s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:12 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3154fcb-c750-4270-a53d-41e155a44432]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe" returned: 0 in 0.962s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe" returned: 1 in 0.530s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:25:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-88a10e97-22d9-423e-a9ce-018ddcdf42fe" returned: 0 in 0.084s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Lock "cinder-quobyte-88a10e97-22d9-423e-a9ce-018ddcdf42fe" released by "delete_volume" :: held 1.897s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:25:15 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Created reservations ['cfced6c8-d9b2-48f7-98b3-b4d56dc73494', '7dbac938-f4c9-46a7-9b67-e6c520dbb861', 'fa964b5a-4d97-4a52-9b79-38d0c1e1d3ec', 'e32b7792-3fdc-4cd2-bcc9-7bcbaae79628'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:25:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:25:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:25:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.139s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:15 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:25:16 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Deleted volume successfully. Sep 17 18:25:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:25:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:25:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:25:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5abe21f4-4212-48db-b3b5-ccd376c31282 tempest-VolumesExtendTest-1744860348 None] Lock "cinder-88a10e97-22d9-423e-a9ce-018ddcdf42fe-delete_volume" released by "delete_volume" :: held 4.365s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:25:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.562s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:25:18 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Flow 'volume_create_manager' (6bd25960-dc80-4589-abe1-688a7b0394bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4338b56-8b52-4088-af53-a76348c92537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4338b56-8b52-4088-af53-a76348c92537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1974274156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdada65-df8e-44d5-ad0b-bd6e5d460aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74090eacb8c343c89f6f12016165c106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:25:18Z,use_quota=True,user_id='65b0e0eb4755465d800ed1396efc67c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5576f7-0df6-4857-b595-a5001bf4baea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5576f7-0df6-4857-b595-a5001bf4baea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30ef36c-ad58-49c5-a008-1c012a906775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30ef36c-ad58-49c5-a008-1c012a906775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcdada65-df8e-44d5-ad0b-bd6e5d460aa1', 'volume_name': 'volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec78052-9783-4dd1-90ab-4c223b12d67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec78052-9783-4dd1-90ab-4c223b12d67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731f7a69-2342-4311-b544-df14d537b2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:18 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Volume dcdada65-df8e-44d5-ad0b-bd6e5d460aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1', 'volume_size': 1} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1974274156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdada65-df8e-44d5-ad0b-bd6e5d460aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74090eacb8c343c89f6f12016165c106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:25:18Z,use_quota=True,user_id='65b0e0eb4755465d800ed1396efc67c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Creating volume dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:25:18 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:25:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:18 devstack quobyte-client[83739]: System call of process 90576 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:25:18 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=35, name=volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:25:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 1073741824" returned: 0 in 0.620s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" returned: 0 in 0.159s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] <== create_volume: return (874ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:25:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731f7a69-2342-4311-b544-df14d537b2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e61793-636d-460d-8613-1499c6e79fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:19 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Volume volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 (dcdada65-df8e-44d5-ad0b-bd6e5d460aa1): created successfully Sep 17 18:25:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e61793-636d-460d-8613-1499c6e79fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Flow 'volume_create_manager' (6bd25960-dc80-4589-abe1-688a7b0394bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:25:19 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d316a7ac-4885-404e-9f15-c75ca9b32aeb tempest-VolumesExtendTest-1744860348 None] Created volume successfully. Sep 17 18:25:20 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Creating offline snapshot 414db0a1-f55b-4ea5-9890-583ca7c0d07b of volume dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:25:20 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a0b8a5-36af-4eb8-b44d-5f7cdbd5c332]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" returned: 0 in 0.497s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:21 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=36, name=volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:25:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b 1G" returned: 0 in 0.329s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): qemu-img rebase -u -b volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] CMD "qemu-img rebase -u -b volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b" returned: 0 in 0.194s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:25:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b" returned: 0 in 0.125s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:25:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b" returned: 0 in 0.262s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.info" returned: 0 in 0.155s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:25:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.info" returned: 0 in 0.146s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:23 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-07224546-baf0-4b46-9dbe-b0b54a4c9a90 tempest-VolumesExtendTest-1744860348 None] Create snapshot completed successfully Sep 17 18:25:23 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-02326f1a-225c-4674-a175-64ae62d88df2 tempest-VolumesExtendTest-1744860348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-02326f1a-225c-4674-a175-64ae62d88df2 tempest-VolumesExtendTest-1744860348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-02326f1a-225c-4674-a175-64ae62d88df2 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.019s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:24 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[62140c27-52a3-4c58-96ee-a782db4d5fc1]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-02326f1a-225c-4674-a175-64ae62d88df2 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:25 devstack quobyte-client[83739]: System call of process 90613 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:25:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-02326f1a-225c-4674-a175-64ae62d88df2 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" returned: 0 in 1.363s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-02326f1a-225c-4674-a175-64ae62d88df2 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b 2G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:25 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:25 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:25:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Flow 'volume_create_manager' (2332c505-5438-46de-9a9d-2d9c7dab767f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:25:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52fb125-1872-44bd-8dfe-b976bc0f10f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52fb125-1872-44bd-8dfe-b976bc0f10f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1547081950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438eb1e0-72da-476a-b24f-17485b8bc2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0246f69124634d03b9fac141b12d7aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:25:25Z,use_quota=True,user_id='d3a394aef2134f8c901c6baf0d448753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23489616-6dcf-4c22-be2f-0d5244ebac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23489616-6dcf-4c22-be2f-0d5244ebac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3effa76-0283-4ffb-8f3f-fcae063e5807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3effa76-0283-4ffb-8f3f-fcae063e5807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438eb1e0-72da-476a-b24f-17485b8bc2a3', 'volume_name': 'volume-438eb1e0-72da-476a-b24f-17485b8bc2a3', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb9caec-3939-4683-9839-1b84556cbf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb9caec-3939-4683-9839-1b84556cbf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8692edd-a776-4725-ae98-22d2442deee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:26 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Volume 438eb1e0-72da-476a-b24f-17485b8bc2a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438eb1e0-72da-476a-b24f-17485b8bc2a3', 'volume_size': 1} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-02326f1a-225c-4674-a175-64ae62d88df2 tempest-VolumesExtendTest-1744860348 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b 2G" returned: 0 in 0.852s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-02326f1a-225c-4674-a175-64ae62d88df2 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.313s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.038s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1547081950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438eb1e0-72da-476a-b24f-17485b8bc2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0246f69124634d03b9fac141b12d7aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:25:25Z,use_quota=True,user_id='d3a394aef2134f8c901c6baf0d448753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Creating volume 438eb1e0-72da-476a-b24f-17485b8bc2a3 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:25:26 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:25:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-438eb1e0-72da-476a-b24f-17485b8bc2a3 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:26 devstack quobyte-client[83739]: System call of process 90619 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:25:26 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=38, name=volume-438eb1e0-72da-476a-b24f-17485b8bc2a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:25:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-438eb1e0-72da-476a-b24f-17485b8bc2a3 1073741824" returned: 0 in 0.843s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-438eb1e0-72da-476a-b24f-17485b8bc2a3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-438eb1e0-72da-476a-b24f-17485b8bc2a3" returned: 0 in 0.273s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] <== create_volume: return (1190ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:25:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8692edd-a776-4725-ae98-22d2442deee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438eb1e0-72da-476a-b24f-17485b8bc2a3', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61077dc-100d-4486-a9cc-1bf92938856f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:27 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Volume volume-438eb1e0-72da-476a-b24f-17485b8bc2a3 (438eb1e0-72da-476a-b24f-17485b8bc2a3): created successfully Sep 17 18:25:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61077dc-100d-4486-a9cc-1bf92938856f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Flow 'volume_create_manager' (2332c505-5438-46de-9a9d-2d9c7dab767f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:25:27 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-02326f1a-225c-4674-a175-64ae62d88df2 tempest-VolumesExtendTest-1744860348 None] Extend volume completed successfully. Sep 17 18:25:27 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ae73a594-c7d5-49e4-baa9-954b5995c46b tempest-AttachVolumeNegativeTest-680660464 None] Created volume successfully. Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Acquiring lock "cinder-414db0a1-f55b-4ea5-9890-583ca7c0d07b-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Lock "cinder-414db0a1-f55b-4ea5-9890-583ca7c0d07b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.118s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:29 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Acquiring lock "cinder-quobyte-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Lock "cinder-quobyte-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Acquiring lock "cinder-quobyte-414db0a1-f55b-4ea5-9890-583ca7c0d07b" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Lock "cinder-quobyte-414db0a1-f55b-4ea5-9890-583ca7c0d07b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Deleting offline snapshot 414db0a1-f55b-4ea5-9890-583ca7c0d07b of volume dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] snapshot_file for this snap is: volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eb4e7c-baf9-4174-8651-4a89d1ac6b9a]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b" returned: 0 in 0.529s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[435db363-61c9-4131-b75a-d2c6a1f61f32]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" returned: 0 in 0.513s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:30 devstack quobyte-client[83739]: System call of process 90717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:25:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b" returned: 0 in 0.351s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1.414db0a1-f55b-4ea5-9890-583ca7c0d07b" returned: 0 in 0.154s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Lock "cinder-quobyte-414db0a1-f55b-4ea5-9890-583ca7c0d07b" released by "_delete_snapshot" :: held 1.913s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:25:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Lock "cinder-quobyte-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" released by "delete_snapshot" :: held 1.961s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:25:31 devstack cinder-volume[83736]: WARNING cinder.quota [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:25:31 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Created reservations ['d386a158-e350-4dd1-a8f5-b80023cab6ac', '07f61ec2-eac9-4ebb-853b-af4577bbd0ea', '6f55eed5-d65a-4d27-99ee-7b41b19ed9ab', 'd3a5c6cc-70cb-4581-a864-104295187ce2'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:25:32 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Delete snapshot completed successfully. Sep 17 18:25:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efbcabcd-d864-4bfa-9071-0d1431a27fba tempest-VolumesExtendTest-1744860348 None] Lock "cinder-414db0a1-f55b-4ea5-9890-583ca7c0d07b-delete_snapshot" released by "delete_snapshot" :: held 3.025s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:25:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Acquiring lock "cinder-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Lock "cinder-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:32 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Acquiring lock "cinder-quobyte-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Lock "cinder-quobyte-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" acquired by "delete_volume" :: waited 0.021s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:32 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4966cfa6-b8db-48d9-bcaa-21bc8cb243b3]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" returned: 0 in 0.709s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" returned: 0 in 0.415s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-6b28e4ca-e987-4097-820c-398791a40439 req-4783849b-30c0-4230-afa9-f69a628a17e4 tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-6b28e4ca-e987-4097-820c-398791a40439 req-4783849b-30c0-4230-afa9-f69a628a17e4 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:34 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f18b985-1469-4970-af81-26457f91c6bd]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-6b28e4ca-e987-4097-820c-398791a40439 req-4783849b-30c0-4230-afa9-f69a628a17e4 tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-438eb1e0-72da-476a-b24f-17485b8bc2a3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:34 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Lock "cinder-quobyte-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1" released by "delete_volume" :: held 1.461s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:25:35 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Created reservations ['c2263686-518a-4e1d-a96d-982724e5c202', 'a24fd8af-e12b-45a7-975d-ec4e56e4f729', '854282ea-3eef-4d19-beb9-44b6adcd8700', '770ab441-27d7-436a-8fd5-09ed66a8fac0'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:25:35 devstack quobyte-client[83739]: System call of process 90748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:25:35 devstack quobyte-client[83739]: System call of process 90748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:25:35 devstack quobyte-client[83739]: System call of process 90748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:25:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-6b28e4ca-e987-4097-820c-398791a40439 req-4783849b-30c0-4230-afa9-f69a628a17e4 tempest-AttachVolumeNegativeTest-680660464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-438eb1e0-72da-476a-b24f-17485b8bc2a3" returned: 0 in 1.364s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-6b28e4ca-e987-4097-820c-398791a40439 req-4783849b-30c0-4230-afa9-f69a628a17e4 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.434s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-6b28e4ca-e987-4097-820c-398791a40439 req-4783849b-30c0-4230-afa9-f69a628a17e4 tempest-AttachVolumeNegativeTest-680660464 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-438eb1e0-72da-476a-b24f-17485b8bc2a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ad6d1c6-cc43-4006-982c-d878647b835a', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:25:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-6b28e4ca-e987-4097-820c-398791a40439 req-4783849b-30c0-4230-afa9-f69a628a17e4 tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.061s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:25:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:25:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-6b28e4ca-e987-4097-820c-398791a40439 req-4783849b-30c0-4230-afa9-f69a628a17e4 tempest-AttachVolumeNegativeTest-680660464 None] attachment_update completed successfully. Sep 17 18:25:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 1.422s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:37 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:25:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Deleted volume successfully. Sep 17 18:25:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-59df8635-6076-438e-8ed1-c2c54ac21087 tempest-VolumesExtendTest-1744860348 None] Lock "cinder-dcdada65-df8e-44d5-ad0b-bd6e5d460aa1-delete_volume" released by "delete_volume" :: held 5.418s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:25:45 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:45 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:25:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Flow 'volume_create_manager' (41ba9aaf-b6be-4299-bce7-25786fa00ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50fa0d14-a4e5-4f53-bc9b-2397f99e735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50fa0d14-a4e5-4f53-bc9b-2397f99e735e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1297798788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df74c876-e6f7-474c-9990-607006d5fe9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfa7ecf384c4feeb1cb169d0504d3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:25:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:25:46Z,use_quota=True,user_id='042fd15e31024783852ce9e5db92e9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d345440-32ee-4c5f-a108-4c52970666f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d345440-32ee-4c5f-a108-4c52970666f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3a8cf0-aadc-4d56-9c0a-4817388afc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3a8cf0-aadc-4d56-9c0a-4817388afc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df74c876-e6f7-474c-9990-607006d5fe9f', 'volume_name': 'volume-df74c876-e6f7-474c-9990-607006d5fe9f', 'volume_size': 2}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f90e9f8-df80-42a1-b1bf-a17fe3360eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f90e9f8-df80-42a1-b1bf-a17fe3360eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c27fa0c-fb23-4378-8d29-a3296c0e1b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:46 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Volume df74c876-e6f7-474c-9990-607006d5fe9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df74c876-e6f7-474c-9990-607006d5fe9f', 'volume_size': 2} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1297798788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df74c876-e6f7-474c-9990-607006d5fe9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfa7ecf384c4feeb1cb169d0504d3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:25:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:25:46Z,use_quota=True,user_id='042fd15e31024783852ce9e5db92e9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Creating volume df74c876-e6f7-474c-9990-607006d5fe9f {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:25:46 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f 2147483648 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:46 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=39, name=volume-df74c876-e6f7-474c-9990-607006d5fe9f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f 2147483648" returned: 0 in 0.569s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f" returned: 0 in 0.213s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] <== create_volume: return (863ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:25:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c27fa0c-fb23-4378-8d29-a3296c0e1b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df74c876-e6f7-474c-9990-607006d5fe9f', 'volume_size': 2}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe09620e-b342-4fc0-934f-d5f3287e9f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:25:47 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Volume volume-df74c876-e6f7-474c-9990-607006d5fe9f (df74c876-e6f7-474c-9990-607006d5fe9f): created successfully Sep 17 18:25:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe09620e-b342-4fc0-934f-d5f3287e9f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:25:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Flow 'volume_create_manager' (41ba9aaf-b6be-4299-bce7-25786fa00ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:25:47 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4d800146-8613-471e-a6b5-eeb9c102a2b7 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Created volume successfully. Sep 17 18:25:48 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Creating offline snapshot 55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 of volume df74c876-e6f7-474c-9990-607006d5fe9f {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:25:48 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b638f0-6421-4dce-9f80-eb5744d7545d]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f" returned: 0 in 0.529s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 2G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:49 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=40, name=volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:25:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 2G" returned: 0 in 0.386s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): qemu-img rebase -u -b volume-df74c876-e6f7-474c-9990-607006d5fe9f -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:49 devstack quobyte-client[83739]: System call of process 91219 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:25:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "qemu-img rebase -u -b volume-df74c876-e6f7-474c-9990-607006d5fe9f -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17" returned: 0 in 0.140s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:25:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17" returned: 0 in 0.085s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:25:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17" returned: 0 in 0.082s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.info" returned: 0 in 0.316s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:25:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.info" returned: 0 in 0.519s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:51 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=50,cinder:INSERT=19,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:25:51 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a77e3b90-c9db-475a-916f-af61d5f25145 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Create snapshot completed successfully Sep 17 18:25:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Acquiring lock "cinder-55d8ed3e-ed62-4fd5-aeab-a6bd94758e17-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "cinder-55d8ed3e-ed62-4fd5-aeab-a6bd94758e17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.110s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:52 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Acquiring lock "cinder-quobyte-df74c876-e6f7-474c-9990-607006d5fe9f" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "cinder-quobyte-df74c876-e6f7-474c-9990-607006d5fe9f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Acquiring lock "cinder-quobyte-55d8ed3e-ed62-4fd5-aeab-a6bd94758e17" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "cinder-quobyte-55d8ed3e-ed62-4fd5-aeab-a6bd94758e17" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Deleting offline snapshot 55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 of volume df74c876-e6f7-474c-9990-607006d5fe9f {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:25:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] snapshot_file for this snap is: volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:25:52 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61d333f-b7a4-40d2-9a0f-a0907a6c87fa]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17" returned: 0 in 1.314s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:53 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df74c876-e6f7-474c-9990-607006d5fe9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:25:53 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0639eb7-4874-4f68-8f07-2529956b1357]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f" returned: 0 in 0.897s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:55 devstack quobyte-client[83739]: System call of process 91278 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:25:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17" returned: 0 in 0.325s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f.55d8ed3e-ed62-4fd5-aeab-a6bd94758e17" returned: 0 in 0.135s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "cinder-quobyte-55d8ed3e-ed62-4fd5-aeab-a6bd94758e17" released by "_delete_snapshot" :: held 3.241s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:25:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "cinder-quobyte-df74c876-e6f7-474c-9990-607006d5fe9f" released by "delete_snapshot" :: held 3.276s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:25:55 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=42,cinder:SELECT=29,cinder:INSERT=6,cinder:DELETE=5 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:25:56 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Created reservations ['3889b989-df6d-49a9-9181-e68fa02ef987', '66be1a4a-d89f-4e17-ba09-dee89df4922c', '3dfb40e3-b54c-4b89-8b73-62a7fa46e6d1', '3c623152-25cf-47fb-b690-9ccd60e348a1'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:25:56 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Delete snapshot completed successfully. Sep 17 18:25:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-737d4bef-92df-4820-a8a3-c17739a9b968 tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "cinder-55d8ed3e-ed62-4fd5-aeab-a6bd94758e17-delete_snapshot" released by "delete_snapshot" :: held 3.872s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:25:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Acquiring lock "cinder-df74c876-e6f7-474c-9990-607006d5fe9f-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "cinder-df74c876-e6f7-474c-9990-607006d5fe9f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:56 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:25:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Acquiring lock "cinder-quobyte-df74c876-e6f7-474c-9990-607006d5fe9f" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:25:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "cinder-quobyte-df74c876-e6f7-474c-9990-607006d5fe9f" acquired by "delete_volume" :: waited 0.015s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:25:56 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[014eb1d4-b301-4e5b-b801-8496d28cc7a8]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:25:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f" returned: 0 in 0.451s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-df74c876-e6f7-474c-9990-607006d5fe9f" returned: 0 in 0.143s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "cinder-quobyte-df74c876-e6f7-474c-9990-607006d5fe9f" released by "delete_volume" :: held 0.758s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:25:57 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Created reservations ['edce3cbd-3a84-4dec-9c34-01109a5de41c', '2a948d4f-dab4-4ee4-a5e1-d03eedd7d01f', '501b5293-4fae-42b2-96a9-1b3d8c7249ef', '00b430cd-b854-425a-8f26-9b20eee54e9a'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:25:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:25:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:25:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:25:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:25:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:25:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:25:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.103s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:25:58 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:25:58 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Deleted volume successfully. Sep 17 18:25:58 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-75a71f75-eb07-44fb-b928-4764e478e7de tempest-VolumesSnapshotNegativeTestJSON-1174904170 None] Lock "cinder-df74c876-e6f7-474c-9990-607006d5fe9f-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:26:08 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=13 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:26:08 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=8,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:26:09 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-e8de4c82-5117-4d1d-ba8c-c5140d7e6017 req-0d84c238-4d18-4043-b929-45e11ea6ccce tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:26:09 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-e8de4c82-5117-4d1d-ba8c-c5140d7e6017 req-0d84c238-4d18-4043-b929-45e11ea6ccce tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:26:09 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-e8de4c82-5117-4d1d-ba8c-c5140d7e6017 req-0d84c238-4d18-4043-b929-45e11ea6ccce tempest-AttachVolumeNegativeTest-680660464 None] Terminate volume connection completed successfully. Sep 17 18:26:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-e8de4c82-5117-4d1d-ba8c-c5140d7e6017 req-0d84c238-4d18-4043-b929-45e11ea6ccce tempest-AttachVolumeNegativeTest-680660464 None] Deleting attachment 2ad6d1c6-cc43-4006-982c-d878647b835a. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:26:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:26:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:26:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:26:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:26:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:26:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:26:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:26:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.327s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:26:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:26:19 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:26:19 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:27:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:27:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:27:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.068s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:27:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:27:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:27:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.072s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:27:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:27:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.413s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:27:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:27:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Acquiring lock "cinder-c3736205-d14c-454e-a413-a184d4282d8c-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:27:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "cinder-c3736205-d14c-454e-a413-a184d4282d8c-delete_volume" acquired by "delete_volume" :: waited 0.254s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:27:18 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:27:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Acquiring lock "cinder-quobyte-c3736205-d14c-454e-a413-a184d4282d8c" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:27:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "cinder-quobyte-c3736205-d14c-454e-a413-a184d4282d8c" acquired by "delete_volume" :: waited 0.015s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:27:18 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0594b0-e372-432e-9654-23e839698dd9]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:27:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c3736205-d14c-454e-a413-a184d4282d8c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:27:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c3736205-d14c-454e-a413-a184d4282d8c" returned: 0 in 1.022s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:27:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c3736205-d14c-454e-a413-a184d4282d8c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:27:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c3736205-d14c-454e-a413-a184d4282d8c" returned: 0 in 0.191s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:27:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "cinder-quobyte-c3736205-d14c-454e-a413-a184d4282d8c" released by "delete_volume" :: held 1.536s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:27:21 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Created reservations ['83fecb37-6dcb-4545-9ba9-90783ded8e1f', 'af54e7e1-1bec-41e6-be93-b143ea3448c2', '09202136-68cb-42d1-adf5-65d0b05a2ce1', '2c3efb6f-275b-4810-8fc0-b946d837eae5'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:27:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:27:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:27:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:27:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:27:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:27:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:27:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.287s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:27:21 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:27:22 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Deleted volume successfully. Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Acquiring lock "cinder-a46f5c92-c344-46b9-9773-0ed08b97b873-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "cinder-a46f5c92-c344-46b9-9773-0ed08b97b873-delete_volume" acquired by "delete_volume" :: waited 0.189s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a75d4f2f-eba8-4ad3-82b1-236a71ad02b9 tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "cinder-c3736205-d14c-454e-a413-a184d4282d8c-delete_volume" released by "delete_volume" :: held 4.031s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:27:22 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Flow 'volume_create_manager' (1216e938-8eb2-4538-a6d8-92956195e565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5c837c-24f6-4d4c-af98-2935603d37c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5c837c-24f6-4d4c-af98-2935603d37c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-517431658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becdd5d7-188c-4635-8146-3f549479fd61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4681bd0da454cab888d81731fb2d8a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:27:23Z,use_quota=True,user_id='a0954408c22e400fa42bf000585b13c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9fec7b-f393-464f-ad4c-018286d5fa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9fec7b-f393-464f-ad4c-018286d5fa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e8bd9e-056f-427c-ba9e-4181d86bd4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e8bd9e-056f-427c-ba9e-4181d86bd4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'becdd5d7-188c-4635-8146-3f549479fd61', 'volume_name': 'volume-becdd5d7-188c-4635-8146-3f549479fd61', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f73d8d-89bf-433f-8721-439bbd272893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f73d8d-89bf-433f-8721-439bbd272893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9363f926-d7c8-400a-9c0a-3ba35cdddc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:27:22 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Volume becdd5d7-188c-4635-8146-3f549479fd61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-becdd5d7-188c-4635-8146-3f549479fd61', 'volume_size': 1} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:27:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-517431658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becdd5d7-188c-4635-8146-3f549479fd61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4681bd0da454cab888d81731fb2d8a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:27:23Z,use_quota=True,user_id='a0954408c22e400fa42bf000585b13c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Creating volume becdd5d7-188c-4635-8146-3f549479fd61 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:27:23 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-becdd5d7-188c-4635-8146-3f549479fd61 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:27:23 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Acquiring lock "cinder-quobyte-a46f5c92-c344-46b9-9773-0ed08b97b873" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:27:23 devstack quobyte-client[83739]: System call of process 91732 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:27:23 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=42, name=volume-becdd5d7-188c-4635-8146-3f549479fd61, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "cinder-quobyte-a46f5c92-c344-46b9-9773-0ed08b97b873" acquired by "delete_volume" :: waited 0.223s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ad02ac-8545-4857-9767-030f04381bcc]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:27:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a46f5c92-c344-46b9-9773-0ed08b97b873 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-becdd5d7-188c-4635-8146-3f549479fd61 1073741824" returned: 0 in 1.027s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-becdd5d7-188c-4635-8146-3f549479fd61 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a46f5c92-c344-46b9-9773-0ed08b97b873" returned: 0 in 0.671s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a46f5c92-c344-46b9-9773-0ed08b97b873 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-becdd5d7-188c-4635-8146-3f549479fd61" returned: 0 in 0.326s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] <== create_volume: return (1462ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a46f5c92-c344-46b9-9773-0ed08b97b873" returned: 0 in 0.328s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9363f926-d7c8-400a-9c0a-3ba35cdddc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-becdd5d7-188c-4635-8146-3f549479fd61', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f87305a-0d4f-45e0-99a1-77b91e8f3e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "cinder-quobyte-a46f5c92-c344-46b9-9773-0ed08b97b873" released by "delete_volume" :: held 1.295s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:27:24 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Volume volume-becdd5d7-188c-4635-8146-3f549479fd61 (becdd5d7-188c-4635-8146-3f549479fd61): created successfully Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f87305a-0d4f-45e0-99a1-77b91e8f3e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Flow 'volume_create_manager' (1216e938-8eb2-4538-a6d8-92956195e565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:27:24 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ccafafdf-4315-4dfd-9e52-8e733d0060d2 tempest-TestMinimumBasicScenario-308593320 None] Created volume successfully. Sep 17 18:27:24 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Created reservations ['786d093c-df00-463a-ba73-f68626006ff9', '80df4831-6b09-4b32-beaf-3f722c5453bf', '6c64ed18-5d77-4a70-bda8-171135dac171', '610ca56f-fb47-4047-8dda-607a561c9ca7'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:27:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:27:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:27:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:27:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:27:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:27:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:27:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.125s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:27:25 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:27:25 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Deleted volume successfully. Sep 17 18:27:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-29428d37-463c-4284-ad72-74428a0b694b tempest-AttachVolumeShelveTestJSON-1264840312 None] Lock "cinder-a46f5c92-c344-46b9-9773-0ed08b97b873-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:27:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-4377a2f9-f914-4a9a-a451-63cefccbdc87 req-5bc685a3-a604-4336-b0f9-ed2be54e09eb tempest-TestMinimumBasicScenario-308593320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:27:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-4377a2f9-f914-4a9a-a451-63cefccbdc87 req-5bc685a3-a604-4336-b0f9-ed2be54e09eb tempest-TestMinimumBasicScenario-308593320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:27:32 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe913d6a-9608-47fe-9972-9ea661f89890]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:27:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-4377a2f9-f914-4a9a-a451-63cefccbdc87 req-5bc685a3-a604-4336-b0f9-ed2be54e09eb tempest-TestMinimumBasicScenario-308593320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-becdd5d7-188c-4635-8146-3f549479fd61 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:27:32 devstack quobyte-client[83739]: System call of process 91785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:27:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-4377a2f9-f914-4a9a-a451-63cefccbdc87 req-5bc685a3-a604-4336-b0f9-ed2be54e09eb tempest-TestMinimumBasicScenario-308593320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-becdd5d7-188c-4635-8146-3f549479fd61" returned: 0 in 0.918s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:27:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-4377a2f9-f914-4a9a-a451-63cefccbdc87 req-5bc685a3-a604-4336-b0f9-ed2be54e09eb tempest-TestMinimumBasicScenario-308593320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.106s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:27:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-4377a2f9-f914-4a9a-a451-63cefccbdc87 req-5bc685a3-a604-4336-b0f9-ed2be54e09eb tempest-TestMinimumBasicScenario-308593320 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-becdd5d7-188c-4635-8146-3f549479fd61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89ba206e-04b2-4160-8937-2a905f94630b', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:27:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-4377a2f9-f914-4a9a-a451-63cefccbdc87 req-5bc685a3-a604-4336-b0f9-ed2be54e09eb tempest-TestMinimumBasicScenario-308593320 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:27:34 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-4377a2f9-f914-4a9a-a451-63cefccbdc87 req-5bc685a3-a604-4336-b0f9-ed2be54e09eb tempest-TestMinimumBasicScenario-308593320 None] attachment_update completed successfully. Sep 17 18:27:44 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=32,cinder:SELECT=20,cinder:INSERT=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:27:44 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=6,cinder:DELETE=3 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:28:14 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Flow 'volume_create_manager' (f1965b94-0d4f-4944-b015-17e1d1969901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e75b76b-2089-43d5-b36f-823f9d2e987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e75b76b-2089-43d5-b36f-823f9d2e987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-663861459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020f86c9-f903-4b98-88a2-aea2a2d4e2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0246f69124634d03b9fac141b12d7aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:28:14Z,use_quota=True,user_id='d3a394aef2134f8c901c6baf0d448753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca13513-d838-40bd-bc2f-352c3954b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca13513-d838-40bd-bc2f-352c3954b667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae61d63-82a9-48bf-93bd-8d83284aedce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae61d63-82a9-48bf-93bd-8d83284aedce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020f86c9-f903-4b98-88a2-aea2a2d4e2ea', 'volume_name': 'volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b551f63a-11b5-4fb1-8361-fc67f74dbbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b551f63a-11b5-4fb1-8361-fc67f74dbbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef4efff-c365-41c2-a49f-42a91ea94851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:28:14 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Volume 020f86c9-f903-4b98-88a2-aea2a2d4e2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea', 'volume_size': 1} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-663861459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020f86c9-f903-4b98-88a2-aea2a2d4e2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0246f69124634d03b9fac141b12d7aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:28:14Z,use_quota=True,user_id='d3a394aef2134f8c901c6baf0d448753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Creating volume 020f86c9-f903-4b98-88a2-aea2a2d4e2ea {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:28:14 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:28:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:28:15 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=43, name=volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:28:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea 1073741824" returned: 0 in 0.664s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:28:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:28:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea" returned: 0 in 0.260s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:28:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] <== create_volume: return (1128ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:28:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:28:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef4efff-c365-41c2-a49f-42a91ea94851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:28:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b3ab8d-10f1-4335-a139-28f299ab4f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:28:16 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Volume volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea (020f86c9-f903-4b98-88a2-aea2a2d4e2ea): created successfully Sep 17 18:28:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b3ab8d-10f1-4335-a139-28f299ab4f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:28:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Flow 'volume_create_manager' (f1965b94-0d4f-4944-b015-17e1d1969901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:28:16 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-fe891533-c253-4bb3-ad64-704f50d5f03c tempest-AttachVolumeNegativeTest-680660464 None] Created volume successfully. Sep 17 18:28:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:28:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:28:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:28:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:28:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:28:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:28:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:28:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 1.089s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:28:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:28:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-976c6361-bccc-4fd4-a4f5-86ebc39615ab req-7e78e498-408c-49c6-8178-e7b9247c7e06 tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:28:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-976c6361-bccc-4fd4-a4f5-86ebc39615ab req-7e78e498-408c-49c6-8178-e7b9247c7e06 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:28:24 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0407f28a-cfed-4d7f-9f64-197774221110]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:28:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-976c6361-bccc-4fd4-a4f5-86ebc39615ab req-7e78e498-408c-49c6-8178-e7b9247c7e06 tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:28:24 devstack quobyte-client[83739]: System call of process 92358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:28:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-976c6361-bccc-4fd4-a4f5-86ebc39615ab req-7e78e498-408c-49c6-8178-e7b9247c7e06 tempest-AttachVolumeNegativeTest-680660464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea" returned: 0 in 0.540s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:28:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-976c6361-bccc-4fd4-a4f5-86ebc39615ab req-7e78e498-408c-49c6-8178-e7b9247c7e06 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.610s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:28:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-976c6361-bccc-4fd4-a4f5-86ebc39615ab req-7e78e498-408c-49c6-8178-e7b9247c7e06 tempest-AttachVolumeNegativeTest-680660464 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2eba4d18-2e68-4ce2-b7cf-989e84c961d7', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:28:24 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-976c6361-bccc-4fd4-a4f5-86ebc39615ab req-7e78e498-408c-49c6-8178-e7b9247c7e06 tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:28:25 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-976c6361-bccc-4fd4-a4f5-86ebc39615ab req-7e78e498-408c-49c6-8178-e7b9247c7e06 tempest-AttachVolumeNegativeTest-680660464 None] attachment_update completed successfully. Sep 17 18:28:35 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:28:35 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:28:55 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-d3cb8574-366c-4175-9315-5f261b312c92 req-e8fd4767-d7cd-41d5-9a85-49c14f06d06f tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:28:56 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-d3cb8574-366c-4175-9315-5f261b312c92 req-e8fd4767-d7cd-41d5-9a85-49c14f06d06f tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:28:56 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-d3cb8574-366c-4175-9315-5f261b312c92 req-e8fd4767-d7cd-41d5-9a85-49c14f06d06f tempest-AttachVolumeNegativeTest-680660464 None] Terminate volume connection completed successfully. Sep 17 18:28:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-d3cb8574-366c-4175-9315-5f261b312c92 req-e8fd4767-d7cd-41d5-9a85-49c14f06d06f tempest-AttachVolumeNegativeTest-680660464 None] Deleting attachment 2eba4d18-2e68-4ce2-b7cf-989e84c961d7. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:29:05 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:29:06 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:29:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "cinder-020f86c9-f903-4b98-88a2-aea2a2d4e2ea-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:11 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-020f86c9-f903-4b98-88a2-aea2a2d4e2ea-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:11 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:11 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "cinder-quobyte-020f86c9-f903-4b98-88a2-aea2a2d4e2ea" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:11 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-quobyte-020f86c9-f903-4b98-88a2-aea2a2d4e2ea" acquired by "delete_volume" :: waited 0.050s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:11 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c73e10-ee56-4592-b129-12bec937b875]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:29:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:12 devstack quobyte-client[83739]: System call of process 92729 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:29:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea" returned: 0 in 1.234s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-020f86c9-f903-4b98-88a2-aea2a2d4e2ea" returned: 0 in 0.228s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-quobyte-020f86c9-f903-4b98-88a2-aea2a2d4e2ea" released by "delete_volume" :: held 1.947s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:13 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Created reservations ['ddd7a729-1b9e-4752-bafa-14673d1bbecc', 'c4051de2-8d47-4005-ba50-b6f6308363a7', '6073cbff-8382-4f0d-9205-529707e5f3a3', '633e9b99-8564-432d-a91b-f3b0f2a729b0'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:29:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.232s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:14 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:29:14 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Deleted volume successfully. Sep 17 18:29:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b8b246e5-a750-4262-a701-fdcd39c3491a tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-020f86c9-f903-4b98-88a2-aea2a2d4e2ea-delete_volume" released by "delete_volume" :: held 4.046s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "cinder-438eb1e0-72da-476a-b24f-17485b8bc2a3-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-438eb1e0-72da-476a-b24f-17485b8bc2a3-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:16 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "cinder-quobyte-438eb1e0-72da-476a-b24f-17485b8bc2a3" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-quobyte-438eb1e0-72da-476a-b24f-17485b8bc2a3" acquired by "delete_volume" :: waited 0.025s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:16 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[acce8c39-dac1-4f98-b3f9-883af02f02c0]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:29:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-438eb1e0-72da-476a-b24f-17485b8bc2a3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:29:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.423s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:29:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-438eb1e0-72da-476a-b24f-17485b8bc2a3" returned: 0 in 1.325s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-438eb1e0-72da-476a-b24f-17485b8bc2a3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-438eb1e0-72da-476a-b24f-17485b8bc2a3" returned: 0 in 0.184s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-quobyte-438eb1e0-72da-476a-b24f-17485b8bc2a3" released by "delete_volume" :: held 1.834s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:18 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Created reservations ['5e46bdfe-96c2-47ff-9e0d-71f5c2ade8dc', '58927581-8585-433a-b400-ede0d2260760', 'e0c78ba3-b773-48bd-a206-006efd70db67', '57558de3-7e39-4d85-8859-4cf385fbe2ce'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:29:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.162s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:19 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:29:19 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Deleted volume successfully. Sep 17 18:29:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-459b9766-cd3c-4137-8e7c-3cdadaf84900 tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-438eb1e0-72da-476a-b24f-17485b8bc2a3-delete_volume" released by "delete_volume" :: held 3.537s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "cinder-2672b6d8-8e19-4e98-a791-ea43e3911379-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-2672b6d8-8e19-4e98-a791-ea43e3911379-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:20 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "cinder-quobyte-2672b6d8-8e19-4e98-a791-ea43e3911379" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-quobyte-2672b6d8-8e19-4e98-a791-ea43e3911379" acquired by "delete_volume" :: waited 0.041s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:20 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1b16e8-232f-4fe0-b5eb-36e481f8ae7e]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:29:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2672b6d8-8e19-4e98-a791-ea43e3911379 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2672b6d8-8e19-4e98-a791-ea43e3911379" returned: 0 in 0.755s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2672b6d8-8e19-4e98-a791-ea43e3911379 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2672b6d8-8e19-4e98-a791-ea43e3911379" returned: 0 in 0.185s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-quobyte-2672b6d8-8e19-4e98-a791-ea43e3911379" released by "delete_volume" :: held 1.109s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:22 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Created reservations ['f2d724c5-ec9c-49fd-b491-5bf8a9f9602c', 'dd2b7f71-7545-4f40-8ab9-f6f39d70af35', '165a6fb5-52db-46df-a86a-9795ad48ee9a', '7619f955-bfff-46cf-a486-ff1b9991860c'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:29:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.122s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:22 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:29:22 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Deleted volume successfully. Sep 17 18:29:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b1468519-405a-4dba-83de-42bb3b8cc958 tempest-AttachVolumeNegativeTest-680660464 None] Lock "cinder-2672b6d8-8e19-4e98-a791-ea43e3911379-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=14,cinder:UPDATE=26,cinder:INSERT=3,cinder:DELETE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:29:32 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Flow 'volume_create_manager' (e9d84ac5-315e-49fd-9c69-18f117fb9f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac29739-0316-421f-8061-550c9b9c1441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac29739-0316-421f-8061-550c9b9c1441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-668235350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1191b3b3-43cd-41e9-886d-9729da5f9fa2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d3cac0827d640ebb0c3eb1502625140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:29:32Z,use_quota=True,user_id='9188780f7a7943ca810e611971174c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b1ada9-8fd6-47f7-b63b-7a434e91d8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b1ada9-8fd6-47f7-b63b-7a434e91d8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f18dcbb-e47e-481a-94a9-34431fb40819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f18dcbb-e47e-481a-94a9-34431fb40819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1191b3b3-43cd-41e9-886d-9729da5f9fa2', 'volume_name': 'volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad52a06-f821-4791-a153-46d9267e379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad52a06-f821-4791-a153-46d9267e379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e4bf1f-1f6f-4c16-8073-02d835409e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:32 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Volume 1191b3b3-43cd-41e9-886d-9729da5f9fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2', 'volume_size': 1} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-668235350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1191b3b3-43cd-41e9-886d-9729da5f9fa2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d3cac0827d640ebb0c3eb1502625140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:29:32Z,use_quota=True,user_id='9188780f7a7943ca810e611971174c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Creating volume 1191b3b3-43cd-41e9-886d-9729da5f9fa2 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:29:32 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:29:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:32 devstack quobyte-client[83739]: System call of process 92771 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:29:32 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=44, name=volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:29:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2 1073741824" returned: 0 in 0.467s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2" returned: 0 in 0.094s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] <== create_volume: return (684ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:29:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e4bf1f-1f6f-4c16-8073-02d835409e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedae338-5358-46b6-aa19-86fe160f94f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:33 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Volume volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2 (1191b3b3-43cd-41e9-886d-9729da5f9fa2): created successfully Sep 17 18:29:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedae338-5358-46b6-aa19-86fe160f94f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Flow 'volume_create_manager' (e9d84ac5-315e-49fd-9c69-18f117fb9f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:29:33 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-acc38dcc-5eb7-4ec4-89bf-884d4f580a07 req-1d228ca1-94c0-45eb-9959-5957be1ebd0f tempest-VolumesGetTestJSON-2085062092 None] Created volume successfully. Sep 17 18:29:34 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Acquiring lock "cinder-1191b3b3-43cd-41e9-886d-9729da5f9fa2-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:34 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Lock "cinder-1191b3b3-43cd-41e9-886d-9729da5f9fa2-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Acquiring lock "cinder-quobyte-1191b3b3-43cd-41e9-886d-9729da5f9fa2" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Lock "cinder-quobyte-1191b3b3-43cd-41e9-886d-9729da5f9fa2" acquired by "delete_volume" :: waited 0.015s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:35 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df0cfc0-b251-4782-8c13-a8b5bd6edede]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:29:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2" returned: 0 in 0.565s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1191b3b3-43cd-41e9-886d-9729da5f9fa2" returned: 0 in 0.114s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Lock "cinder-quobyte-1191b3b3-43cd-41e9-886d-9729da5f9fa2" released by "delete_volume" :: held 0.901s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:36 devstack cinder-volume[83736]: DEBUG cinder.quota [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Created reservations ['f996eacb-a780-424f-a16c-72252e882b3f', '115455ec-42d1-4f9f-939e-ff78c68300dd', 'e03fa463-305f-4a23-89da-c4cd17e1dbca', 'be0f6522-dac3-4efc-a33f-a73eb7788304'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:29:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.123s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:36 devstack cinder-volume[83736]: DEBUG cinder.manager [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:29:36 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Deleted volume successfully. Sep 17 18:29:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-0154fa34-1c51-4eae-ba45-7f1600a33461 req-17159ae6-55be-4d21-a223-0dfd2f031738 tempest-VolumesGetTestJSON-2085062092 None] Lock "cinder-1191b3b3-43cd-41e9-886d-9729da5f9fa2-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:41 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Flow 'volume_create_manager' (d8d46749-cc13-44eb-8e6d-eae17797dd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13bb1c1-835d-4638-8ce5-4733b0874b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13bb1c1-835d-4638-8ce5-4733b0874b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1604775580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84882fbf-7cb0-4a14-83af-7388c96382ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e16825221774e4ba0716a956e641d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:29:41Z,use_quota=True,user_id='aa4ffe8729ef4c69866eb9b3c97e1e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3d5016-fb6f-42c9-b115-403db289622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3d5016-fb6f-42c9-b115-403db289622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95539a43-03a2-4018-ac35-23b2c4efb02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95539a43-03a2-4018-ac35-23b2c4efb02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84882fbf-7cb0-4a14-83af-7388c96382ed', 'volume_name': 'volume-84882fbf-7cb0-4a14-83af-7388c96382ed', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3488d19-b21e-4333-bdeb-cb6337a1382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3488d19-b21e-4333-bdeb-cb6337a1382f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc29f618-5d35-4781-947d-fd4872cd2a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:41 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Volume 84882fbf-7cb0-4a14-83af-7388c96382ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84882fbf-7cb0-4a14-83af-7388c96382ed', 'volume_size': 1} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1604775580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84882fbf-7cb0-4a14-83af-7388c96382ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e16825221774e4ba0716a956e641d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:29:41Z,use_quota=True,user_id='aa4ffe8729ef4c69866eb9b3c97e1e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Creating volume 84882fbf-7cb0-4a14-83af-7388c96382ed {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:29:41 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84882fbf-7cb0-4a14-83af-7388c96382ed 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:41 devstack quobyte-client[83739]: System call of process 92796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:29:41 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=45, name=volume-84882fbf-7cb0-4a14-83af-7388c96382ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84882fbf-7cb0-4a14-83af-7388c96382ed 1073741824" returned: 0 in 0.387s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84882fbf-7cb0-4a14-83af-7388c96382ed {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84882fbf-7cb0-4a14-83af-7388c96382ed" returned: 0 in 0.096s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] <== create_volume: return (555ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:29:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.568s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc29f618-5d35-4781-947d-fd4872cd2a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84882fbf-7cb0-4a14-83af-7388c96382ed', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf38e46-2706-46cb-bd96-0f708f3bd5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:42 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Volume volume-84882fbf-7cb0-4a14-83af-7388c96382ed (84882fbf-7cb0-4a14-83af-7388c96382ed): created successfully Sep 17 18:29:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf38e46-2706-46cb-bd96-0f708f3bd5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Flow 'volume_create_manager' (d8d46749-cc13-44eb-8e6d-eae17797dd1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:29:42 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-952d9b11-96c6-4a55-a31b-2c12d527dc22 tempest-VolumesTestJSON-32034292 None] Created volume successfully. Sep 17 18:29:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Flow 'volume_create_manager' (cd4ddaeb-5e45-4797-972c-00d7b27594b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbbe951-fae2-4ae2-a084-4874037290e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbbe951-fae2-4ae2-a084-4874037290e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-152642169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ee421-aec1-4464-93b7-0891ea55f093,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e16825221774e4ba0716a956e641d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:29:44Z,use_quota=True,user_id='aa4ffe8729ef4c69866eb9b3c97e1e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb60544-20aa-4428-800b-fd99579105ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb60544-20aa-4428-800b-fd99579105ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23da143-762d-40df-bb3a-d95b7e31ba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23da143-762d-40df-bb3a-d95b7e31ba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54ee421-aec1-4464-93b7-0891ea55f093', 'volume_name': 'volume-b54ee421-aec1-4464-93b7-0891ea55f093', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda25e67-2249-4fb5-a1c1-f41539a985d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda25e67-2249-4fb5-a1c1-f41539a985d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2117f9fa-bf28-4f0a-b83f-67f4562d70c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:43 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Volume b54ee421-aec1-4464-93b7-0891ea55f093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54ee421-aec1-4464-93b7-0891ea55f093', 'volume_size': 1} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-152642169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ee421-aec1-4464-93b7-0891ea55f093,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e16825221774e4ba0716a956e641d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:29:44Z,use_quota=True,user_id='aa4ffe8729ef4c69866eb9b3c97e1e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Creating volume b54ee421-aec1-4464-93b7-0891ea55f093 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:29:43 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:29:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b54ee421-aec1-4464-93b7-0891ea55f093 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:44 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=46, name=volume-b54ee421-aec1-4464-93b7-0891ea55f093, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:29:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b54ee421-aec1-4464-93b7-0891ea55f093 1073741824" returned: 0 in 0.363s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b54ee421-aec1-4464-93b7-0891ea55f093 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b54ee421-aec1-4464-93b7-0891ea55f093" returned: 0 in 0.101s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] <== create_volume: return (538ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:29:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.553s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2117f9fa-bf28-4f0a-b83f-67f4562d70c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54ee421-aec1-4464-93b7-0891ea55f093', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ddf41c-3e00-4e5b-a310-6c9d588afbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:44 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Volume volume-b54ee421-aec1-4464-93b7-0891ea55f093 (b54ee421-aec1-4464-93b7-0891ea55f093): created successfully Sep 17 18:29:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ddf41c-3e00-4e5b-a310-6c9d588afbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Flow 'volume_create_manager' (cd4ddaeb-5e45-4797-972c-00d7b27594b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:29:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-9e9a2ad1-cab5-4866-8204-c0a814379e88 tempest-VolumesTestJSON-32034292 None] Created volume successfully. Sep 17 18:29:46 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Flow 'volume_create_manager' (7f47672e-81ff-460f-809a-aa13e0b37d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0055071-d1c2-4749-950b-d8895e619ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0055071-d1c2-4749-950b-d8895e619ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2095457310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdae974-300c-46fe-9816-7a68ff90b2d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e16825221774e4ba0716a956e641d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:29:46Z,use_quota=True,user_id='aa4ffe8729ef4c69866eb9b3c97e1e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b65d725-eccc-48bb-8d2e-ce38a1f6fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b65d725-eccc-48bb-8d2e-ce38a1f6fe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c648b07b-7ad3-4555-9484-2b0476ee33fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c648b07b-7ad3-4555-9484-2b0476ee33fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fdae974-300c-46fe-9816-7a68ff90b2d9', 'volume_name': 'volume-1fdae974-300c-46fe-9816-7a68ff90b2d9', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d0c717-c3d8-4205-9098-223fc24f296e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d0c717-c3d8-4205-9098-223fc24f296e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5188a97-f58d-4424-aac8-0b3a260de2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:46 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Volume 1fdae974-300c-46fe-9816-7a68ff90b2d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fdae974-300c-46fe-9816-7a68ff90b2d9', 'volume_size': 1} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2095457310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdae974-300c-46fe-9816-7a68ff90b2d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e16825221774e4ba0716a956e641d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:29:46Z,use_quota=True,user_id='aa4ffe8729ef4c69866eb9b3c97e1e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Creating volume 1fdae974-300c-46fe-9816-7a68ff90b2d9 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:29:46 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:29:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1fdae974-300c-46fe-9816-7a68ff90b2d9 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:46 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=47, name=volume-1fdae974-300c-46fe-9816-7a68ff90b2d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:29:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1fdae974-300c-46fe-9816-7a68ff90b2d9 1073741824" returned: 0 in 0.393s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1fdae974-300c-46fe-9816-7a68ff90b2d9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1fdae974-300c-46fe-9816-7a68ff90b2d9" returned: 0 in 0.142s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] <== create_volume: return (622ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:29:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.635s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5188a97-f58d-4424-aac8-0b3a260de2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fdae974-300c-46fe-9816-7a68ff90b2d9', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4615a4c7-f18b-426b-a366-23c88d190a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:47 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Volume volume-1fdae974-300c-46fe-9816-7a68ff90b2d9 (1fdae974-300c-46fe-9816-7a68ff90b2d9): created successfully Sep 17 18:29:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4615a4c7-f18b-426b-a366-23c88d190a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Flow 'volume_create_manager' (7f47672e-81ff-460f-809a-aa13e0b37d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:29:47 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-822c8920-9a38-48c6-a6c3-f815acae7c7e tempest-VolumesTestJSON-32034292 None] Created volume successfully. Sep 17 18:29:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Acquiring lock "cinder-1fdae974-300c-46fe-9816-7a68ff90b2d9-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Lock "cinder-1fdae974-300c-46fe-9816-7a68ff90b2d9-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:49 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Acquiring lock "cinder-quobyte-1fdae974-300c-46fe-9816-7a68ff90b2d9" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Lock "cinder-quobyte-1fdae974-300c-46fe-9816-7a68ff90b2d9" acquired by "delete_volume" :: waited 0.017s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:50 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aa3f1d-f8e7-49da-9223-5393cdcaed62]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:29:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1fdae974-300c-46fe-9816-7a68ff90b2d9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1fdae974-300c-46fe-9816-7a68ff90b2d9" returned: 0 in 0.584s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1fdae974-300c-46fe-9816-7a68ff90b2d9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1fdae974-300c-46fe-9816-7a68ff90b2d9" returned: 0 in 0.128s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Lock "cinder-quobyte-1fdae974-300c-46fe-9816-7a68ff90b2d9" released by "delete_volume" :: held 0.897s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:51 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Created reservations ['aa7de77d-f7fc-46f7-ac53-f54fabfb147e', 'a3623616-8dcb-4c1e-b937-0e2f476c63dc', 'dfb48647-2c91-475d-85ce-3bf873033304', '77e0e52a-01c5-4fe6-9281-6050dd7b00a7'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:29:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.128s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:51 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:29:51 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Deleted volume successfully. Sep 17 18:29:51 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a1f1cc2d-7411-496c-a999-6840af6971d2 tempest-VolumesTestJSON-32034292 None] Lock "cinder-1fdae974-300c-46fe-9816-7a68ff90b2d9-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Acquiring lock "cinder-b54ee421-aec1-4464-93b7-0891ea55f093-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Lock "cinder-b54ee421-aec1-4464-93b7-0891ea55f093-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:52 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Acquiring lock "cinder-quobyte-b54ee421-aec1-4464-93b7-0891ea55f093" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Lock "cinder-quobyte-b54ee421-aec1-4464-93b7-0891ea55f093" acquired by "delete_volume" :: waited 0.025s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:52 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1fad5f-72f7-4304-b5ef-39bba186fe66]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:29:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b54ee421-aec1-4464-93b7-0891ea55f093 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b54ee421-aec1-4464-93b7-0891ea55f093" returned: 0 in 0.485s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b54ee421-aec1-4464-93b7-0891ea55f093 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b54ee421-aec1-4464-93b7-0891ea55f093" returned: 0 in 0.161s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:53 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Lock "cinder-quobyte-b54ee421-aec1-4464-93b7-0891ea55f093" released by "delete_volume" :: held 0.868s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:53 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Created reservations ['f158b9f3-8206-4058-a1ec-df2cda2e2221', '58af2eb9-5a58-4c6d-b1a4-a3a253bd4973', '2cfbc706-1eed-44d0-8482-6a36c758be7d', '939c31de-188d-4163-95e8-5b3179c6cb59'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.109s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:29:54 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Deleted volume successfully. Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ccdd1b93-10eb-4d71-b7da-e07620fbee52 tempest-VolumesTestJSON-32034292 None] Lock "cinder-b54ee421-aec1-4464-93b7-0891ea55f093-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Acquiring lock "cinder-84882fbf-7cb0-4a14-83af-7388c96382ed-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Lock "cinder-84882fbf-7cb0-4a14-83af-7388c96382ed-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:54 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Acquiring lock "cinder-quobyte-84882fbf-7cb0-4a14-83af-7388c96382ed" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:29:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Lock "cinder-quobyte-84882fbf-7cb0-4a14-83af-7388c96382ed" acquired by "delete_volume" :: waited 0.018s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:29:55 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a457bb97-31e7-4bc5-9f2d-66f99b708cf6]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:29:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84882fbf-7cb0-4a14-83af-7388c96382ed {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84882fbf-7cb0-4a14-83af-7388c96382ed" returned: 0 in 0.737s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84882fbf-7cb0-4a14-83af-7388c96382ed {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84882fbf-7cb0-4a14-83af-7388c96382ed" returned: 0 in 0.193s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Lock "cinder-quobyte-84882fbf-7cb0-4a14-83af-7388c96382ed" released by "delete_volume" :: held 1.258s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:29:56 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Created reservations ['ea12e5a3-3b0c-4cf3-bdad-076ef09dd863', 'af7f92d5-1d91-4847-975b-ed12d559dcd5', '64fa9446-00fd-4f29-b917-8868b3b07c23', 'd83c39e5-6e15-4d0a-b866-dd9ba5062b85'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:29:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:29:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.423s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:29:57 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:29:58 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Deleted volume successfully. Sep 17 18:29:59 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Flow 'volume_create_manager' (82e0d147-1fc8-43b2-8f76-b213c48cdbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fab449-ab98-44a5-8cad-ae54533fa1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fab449-ab98-44a5-8cad-ae54533fa1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1179949266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3a5707-f40d-4220-98d9-b0c52e695e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3d457c985f4a78a3dd2f3ed407bc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:29:58Z,use_quota=True,user_id='1cae01c404bf4aee8c8ae3263595cb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d16bf37-edac-4d40-a58a-40fb4ce23e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d16bf37-edac-4d40-a58a-40fb4ce23e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1362257-8ecb-4922-81dd-848ca54d912f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1362257-8ecb-4922-81dd-848ca54d912f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f3a5707-f40d-4220-98d9-b0c52e695e87', 'volume_name': 'volume-8f3a5707-f40d-4220-98d9-b0c52e695e87', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d26fee-2f5f-46a4-b7aa-f4303038f432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d26fee-2f5f-46a4-b7aa-f4303038f432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56823df-bdce-4b90-9870-0204359ab31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:29:59 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Volume 8f3a5707-f40d-4220-98d9-b0c52e695e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f3a5707-f40d-4220-98d9-b0c52e695e87', 'volume_size': 1} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1179949266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3a5707-f40d-4220-98d9-b0c52e695e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3d457c985f4a78a3dd2f3ed407bc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:29:58Z,use_quota=True,user_id='1cae01c404bf4aee8c8ae3263595cb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Creating volume 8f3a5707-f40d-4220-98d9-b0c52e695e87 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:29:59 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:29:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8f3a5707-f40d-4220-98d9-b0c52e695e87 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:00 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=48, name=volume-8f3a5707-f40d-4220-98d9-b0c52e695e87, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:30:00 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8abd4da7-b5d2-4c20-bb20-b417a41d8ed5 tempest-VolumesTestJSON-32034292 None] Lock "cinder-84882fbf-7cb0-4a14-83af-7388c96382ed-delete_volume" released by "delete_volume" :: held 5.615s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:30:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8f3a5707-f40d-4220-98d9-b0c52e695e87 1073741824" returned: 0 in 0.819s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8f3a5707-f40d-4220-98d9-b0c52e695e87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8f3a5707-f40d-4220-98d9-b0c52e695e87" returned: 0 in 0.330s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] <== create_volume: return (1256ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:30:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56823df-bdce-4b90-9870-0204359ab31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f3a5707-f40d-4220-98d9-b0c52e695e87', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ace0be7-b93a-4389-95af-f3801297199f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:01 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Volume volume-8f3a5707-f40d-4220-98d9-b0c52e695e87 (8f3a5707-f40d-4220-98d9-b0c52e695e87): created successfully Sep 17 18:30:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ace0be7-b93a-4389-95af-f3801297199f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Flow 'volume_create_manager' (82e0d147-1fc8-43b2-8f76-b213c48cdbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:30:01 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-95f91fac-114a-46d2-be25-abb7540886e7 tempest-AttachVolumeTestJSON-315441114 None] Created volume successfully. Sep 17 18:30:07 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=44,cinder:INSERT=19,cinder:UPDATE=68,cinder:DELETE=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:30:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-603b0626-7773-4799-8ecf-d6a6afcafa9a req-e79138ed-b1a8-42f2-8ea6-9c8f7111dd82 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-603b0626-7773-4799-8ecf-d6a6afcafa9a req-e79138ed-b1a8-42f2-8ea6-9c8f7111dd82 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:07 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[902a2345-9add-4694-89ed-87f8c78058af]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:30:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-603b0626-7773-4799-8ecf-d6a6afcafa9a req-e79138ed-b1a8-42f2-8ea6-9c8f7111dd82 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8f3a5707-f40d-4220-98d9-b0c52e695e87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:08 devstack quobyte-client[83739]: System call of process 92917 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:30:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-603b0626-7773-4799-8ecf-d6a6afcafa9a req-e79138ed-b1a8-42f2-8ea6-9c8f7111dd82 tempest-AttachVolumeTestJSON-315441114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8f3a5707-f40d-4220-98d9-b0c52e695e87" returned: 0 in 1.071s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-603b0626-7773-4799-8ecf-d6a6afcafa9a req-e79138ed-b1a8-42f2-8ea6-9c8f7111dd82 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.156s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-603b0626-7773-4799-8ecf-d6a6afcafa9a req-e79138ed-b1a8-42f2-8ea6-9c8f7111dd82 tempest-AttachVolumeTestJSON-315441114 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-8f3a5707-f40d-4220-98d9-b0c52e695e87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69f8a16f-0a49-4c37-88e4-254099cb5cab', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:30:09 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-603b0626-7773-4799-8ecf-d6a6afcafa9a req-e79138ed-b1a8-42f2-8ea6-9c8f7111dd82 tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:09 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-603b0626-7773-4799-8ecf-d6a6afcafa9a req-e79138ed-b1a8-42f2-8ea6-9c8f7111dd82 tempest-AttachVolumeTestJSON-315441114 None] attachment_update completed successfully. Sep 17 18:30:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a6203223-f6c8-46ad-9b55-7036f6d7203b tempest-BackendsCapabilitiesAdminTestsJSON-180570473 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83736) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 17 18:30:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-209e2c0b-4f1a-4640-89c4-3d35d0ac7a18 tempest-BackendsCapabilitiesAdminTestsJSON-180570473 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83736) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 17 18:30:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:30:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:30:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:30:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.202s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:30:19 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=41,cinder:SELECT=28,cinder:INSERT=6,cinder:DELETE=6 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:30:19 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:30:20 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-50ae23c7-c9ec-40fa-a172-aded78736a0f tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:20 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-50ae23c7-c9ec-40fa-a172-aded78736a0f tempest-GroupSnapshotsTest-1628267147 None] Group tempest-GroupSnapshotsTest-Group-1453664612: creating Sep 17 18:30:20 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-50ae23c7-c9ec-40fa-a172-aded78736a0f tempest-GroupSnapshotsTest-1628267147 None] Group tempest-GroupSnapshotsTest-Group-1453664612: created successfully Sep 17 18:30:20 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-50ae23c7-c9ec-40fa-a172-aded78736a0f tempest-GroupSnapshotsTest-1628267147 None] Create group completed successfully. Sep 17 18:30:22 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Flow 'volume_create_manager' (f7ba04d7-33c0-4385-a23b-49ba41e11691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e62400-8602-4481-b9b2-7f1b9cd03e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e62400-8602-4481-b9b2-7f1b9cd03e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2137104757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c29f121-9fe2-4c94-8f99-98508ecb5f08,host='devstack@QuobyteHD#QuobyteHD',id=1d06e5b3-a640-457e-a46e-2def93ebbc74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99e6fcce7b44f1d8214e27375f8cecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:30:22Z,use_quota=True,user_id='511b8715dadb4817a590b02e08256ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dc9d95e-7ec1-4954-945f-6900cdd32a39),volume_type_id=3dc9d95e-7ec1-4954-945f-6900cdd32a39)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ee9f54-c1b0-4460-a969-8b084b15c047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ee9f54-c1b0-4460-a969-8b084b15c047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8799ae74-8845-4cd7-928f-d3ef9c8d0d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8799ae74-8845-4cd7-928f-d3ef9c8d0d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d06e5b3-a640-457e-a46e-2def93ebbc74', 'volume_name': 'volume-1d06e5b3-a640-457e-a46e-2def93ebbc74', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cf4265-84d8-4b33-9594-f978106dcf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cf4265-84d8-4b33-9594-f978106dcf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5e79ff-7306-4d5a-bf68-84c2ab2bc015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:22 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Volume 1d06e5b3-a640-457e-a46e-2def93ebbc74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d06e5b3-a640-457e-a46e-2def93ebbc74', 'volume_size': 1} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0c29f121-9fe2-4c94-8f99-98508ecb5f08,created_at=2025-09-17T16:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2137104757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c29f121-9fe2-4c94-8f99-98508ecb5f08,host='devstack@QuobyteHD#QuobyteHD',id=1d06e5b3-a640-457e-a46e-2def93ebbc74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99e6fcce7b44f1d8214e27375f8cecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:30:22Z,use_quota=True,user_id='511b8715dadb4817a590b02e08256ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dc9d95e-7ec1-4954-945f-6900cdd32a39),volume_type_id=3dc9d95e-7ec1-4954-945f-6900cdd32a39)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Creating volume 1d06e5b3-a640-457e-a46e-2def93ebbc74 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:30:22 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:22 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=49, name=volume-1d06e5b3-a640-457e-a46e-2def93ebbc74, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 1073741824" returned: 0 in 0.323s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74" returned: 0 in 0.085s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] <== create_volume: return (475ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:30:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.488s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5e79ff-7306-4d5a-bf68-84c2ab2bc015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d06e5b3-a640-457e-a46e-2def93ebbc74', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2290f974-1c0b-4e61-9f86-372952510918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:23 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Volume volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 (1d06e5b3-a640-457e-a46e-2def93ebbc74): created successfully Sep 17 18:30:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2290f974-1c0b-4e61-9f86-372952510918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Flow 'volume_create_manager' (f7ba04d7-33c0-4385-a23b-49ba41e11691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:30:23 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-824fdd3f-5a40-4bcf-b285-c684872bd037 tempest-GroupSnapshotsTest-1628267147 None] Created volume successfully. Sep 17 18:30:23 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] GroupSnapshot 21774e3d-01c2-46c0-9bd4-d94154f05775: creating. Sep 17 18:30:23 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Group snapshot 21774e3d-01c2-46c0-9bd4-d94154f05775: creating. {{(pid=83736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 17 18:30:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Creating offline snapshot 0f8c96ed-e037-4402-a375-84f15a3a7bdc of volume 1d06e5b3-a640-457e-a46e-2def93ebbc74 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:30:23 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ef561f-dc01-4f17-b861-74f7fd90fc76]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:30:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74" returned: 0 in 0.459s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:24 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=50, name=volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc 1G" returned: 0 in 0.220s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img rebase -u -b volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc" returned: 0 in 0.125s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc" returned: 0 in 0.085s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc" returned: 0 in 0.120s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.info" returned: 0 in 0.316s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:30:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.info" returned: 0 in 0.117s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:25 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-131dca0b-e514-4947-ad8e-5bd2338a2f8d tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 21774e3d-01c2-46c0-9bd4-d94154f05775: created successfully Sep 17 18:30:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-0f8c96ed-e037-4402-a375-84f15a3a7bdc-a0bcec0e-1d78-4623-a786-853e2b0a3bca" by "_create_volume_from_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-0f8c96ed-e037-4402-a375-84f15a3a7bdc-a0bcec0e-1d78-4623-a786-853e2b0a3bca" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Creating volume a0bcec0e-1d78-4623-a786-853e2b0a3bca from snapshot 0f8c96ed-e037-4402-a375-84f15a3a7bdc {{(pid=83736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-a0bcec0e-1d78-4623-a786-853e2b0a3bca" by "_copy_volume_from_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-a0bcec0e-1d78-4623-a786-853e2b0a3bca" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] snapshot: 0f8c96ed-e037-4402-a375-84f15a3a7bdc, volume: a0bcec0e-1d78-4623-a786-853e2b0a3bca, {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4a502a-4cec-40e9-9bfd-641ee35980bf]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc" returned: 0 in 0.460s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d06e5b3-a640-457e-a46e-2def93ebbc74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Creating direct copy from snapshot {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 17 18:30:28 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60b6b49-8370-435f-aa5a-aed23251b012]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:30:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:29 devstack quobyte-client[83739]: System call of process 93074 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:30:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74" returned: 0 in 1.058s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:30 devstack cinder-volume[83736]: DEBUG cinder.utils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca not found in is_blk_device check {{(pid=83736) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 17 18:30:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:30 devstack quobyte-client[83739]: System call of process 93115 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:30:30 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=52, name=volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:30:30 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-158c0240-cdbe-4b2e-aa91-e952001e334c req-46e26246-c54e-4cc4-9f47-452fde3fce22 tempest-TestMinimumBasicScenario-308593320 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:32 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-158c0240-cdbe-4b2e-aa91-e952001e334c req-46e26246-c54e-4cc4-9f47-452fde3fce22 tempest-TestMinimumBasicScenario-308593320 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:32 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-158c0240-cdbe-4b2e-aa91-e952001e334c req-46e26246-c54e-4cc4-9f47-452fde3fce22 tempest-TestMinimumBasicScenario-308593320 None] Terminate volume connection completed successfully. Sep 17 18:30:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-158c0240-cdbe-4b2e-aa91-e952001e334c req-46e26246-c54e-4cc4-9f47-452fde3fce22 tempest-TestMinimumBasicScenario-308593320 None] Deleting attachment 89ba206e-04b2-4160-8937-2a905f94630b. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:30:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Acquiring lock "cinder-becdd5d7-188c-4635-8146-3f549479fd61-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:30:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Lock "cinder-becdd5d7-188c-4635-8146-3f549479fd61-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:30:38 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Acquiring lock "cinder-quobyte-becdd5d7-188c-4635-8146-3f549479fd61" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:30:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Lock "cinder-quobyte-becdd5d7-188c-4635-8146-3f549479fd61" acquired by "delete_volume" :: waited 0.048s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:30:38 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f095939c-ef66-4d7b-918c-a00be4a06d9c]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:30:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-becdd5d7-188c-4635-8146-3f549479fd61 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca" returned: 0 in 8.150s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:38 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f5d041-c55e-431b-af89-a7728770c512]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:30:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-becdd5d7-188c-4635-8146-3f549479fd61" returned: 0 in 0.794s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-becdd5d7-188c-4635-8146-3f549479fd61 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-becdd5d7-188c-4635-8146-3f549479fd61" returned: 0 in 0.130s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74" returned: 0 in 0.866s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:30:39 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Converted 1024.00 MB image at 124.80 MB/s Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Lock "cinder-quobyte-becdd5d7-188c-4635-8146-3f549479fd61" released by "delete_volume" :: held 1.282s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca" returned: 0 in 0.290s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-a0bcec0e-1d78-4623-a786-853e2b0a3bca" released by "_copy_volume_from_snapshot" :: held 11.259s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-0f8c96ed-e037-4402-a375-84f15a3a7bdc-a0bcec0e-1d78-4623-a786-853e2b0a3bca" released by "_create_volume_from_snapshot" :: held 11.342s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.403s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:39 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Created reservations ['d430dec9-728a-40bd-b6a6-56a38501e3bb', 'a15034e1-863b-4bf0-8d33-bb17c78f1bd8', '7d550edb-123b-43e6-87cf-9357b425e89e', '3b1593cc-2d65-46dd-b8da-98fd0bf8e3fb'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:30:40 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-cd760ada-6091-4940-a7c5-878f48d9337c tempest-GroupSnapshotsTest-1628267147 None] Create group from source-snapshot-21774e3d-01c2-46c0-9bd4-d94154f05775 completed successfully. Sep 17 18:30:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:40 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:30:40 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:30:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.159s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:40 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:30:40 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Deleted volume successfully. Sep 17 18:30:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7404b7c8-6602-44b5-a150-f60785167695 tempest-TestMinimumBasicScenario-308593320 None] Lock "cinder-becdd5d7-188c-4635-8146-3f549479fd61-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:30:41 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-a0bcec0e-1d78-4623-a786-853e2b0a3bca" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:30:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-a0bcec0e-1d78-4623-a786-853e2b0a3bca" acquired by "delete_volume" :: waited 0.021s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:30:41 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecbde84-4b7c-4227-954d-19ce6e7931c3]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:30:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca" returned: 0 in 1.213s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0bcec0e-1d78-4623-a786-853e2b0a3bca" returned: 0 in 0.149s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:43 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-a0bcec0e-1d78-4623-a786-853e2b0a3bca" released by "delete_volume" :: held 1.697s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:30:43 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['bf72b49a-1ea1-4dee-b6cb-7bc2c3e647ff'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:30:43 devstack cinder-volume[83736]: WARNING cinder.quota [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-782171358 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-782171358, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:30:43 devstack cinder-volume[83736]: WARNING cinder.quota [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-782171358 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-782171358, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:30:43 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['1de9fa22-e236-4296-ad3b-e1d6ffda294a', '893473fa-0cae-48c5-99ef-6cf2a888b57d', '76068e10-ca24-40fb-b3ca-24837bb402dd', '38473b29-db4e-4476-ba53-0a8ec8570556'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:30:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:30:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:30:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.160s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:44 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:30:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d126beac-75ca-4ea6-a3ee-4d26e2cb2a96 tempest-GroupSnapshotsTest-1628267147 None] Delete group completed successfully. Sep 17 18:30:45 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 21774e3d-01c2-46c0-9bd4-d94154f05775: deleting Sep 17 18:30:45 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 21774e3d-01c2-46c0-9bd4-d94154f05775: deleting {{(pid=83736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-1d06e5b3-a640-457e-a46e-2def93ebbc74" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-1d06e5b3-a640-457e-a46e-2def93ebbc74" acquired by "delete_snapshot" :: waited 0.069s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-0f8c96ed-e037-4402-a375-84f15a3a7bdc" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-0f8c96ed-e037-4402-a375-84f15a3a7bdc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Deleting offline snapshot 0f8c96ed-e037-4402-a375-84f15a3a7bdc of volume 1d06e5b3-a640-457e-a46e-2def93ebbc74 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] snapshot_file for this snap is: volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea938be4-498e-467b-9e72-3433eebf025e]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc" returned: 0 in 0.419s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d06e5b3-a640-457e-a46e-2def93ebbc74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0002aef8-f87f-4270-b8da-56bf1eec0b41]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:30:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74" returned: 0 in 0.486s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc" returned: 0 in 0.182s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74.0f8c96ed-e037-4402-a375-84f15a3a7bdc" returned: 0 in 0.102s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-0f8c96ed-e037-4402-a375-84f15a3a7bdc" released by "_delete_snapshot" :: held 1.541s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:30:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-1d06e5b3-a640-457e-a46e-2def93ebbc74" released by "delete_snapshot" :: held 1.567s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:30:47 devstack cinder-volume[83736]: WARNING cinder.quota [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-782171358 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-782171358, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:30:47 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['6c4a97ce-417e-4a82-a6f6-05e55a6d067e', '92b49f71-5424-4030-8659-b30f0fef53d5', 'a74dc8f7-bbfc-4cbc-8169-5af048292381', 'ae38e735-8415-493f-8b02-3e6234b3d154'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:30:47 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d30c64da-c73b-4d6b-a362-f33c8ca59aa2 tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 21774e3d-01c2-46c0-9bd4-d94154f05775: deleted successfully Sep 17 18:30:48 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:48 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-1d06e5b3-a640-457e-a46e-2def93ebbc74" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:30:48 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-1d06e5b3-a640-457e-a46e-2def93ebbc74" acquired by "delete_volume" :: waited 0.020s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:30:48 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b8c407-59c7-4f78-8122-b24e53126560]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:30:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74" returned: 0 in 0.562s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1d06e5b3-a640-457e-a46e-2def93ebbc74" returned: 0 in 0.136s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-1d06e5b3-a640-457e-a46e-2def93ebbc74" released by "delete_volume" :: held 0.895s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:30:50 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['5cfa5603-5390-4bd4-a440-ba48a190f650'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:30:50 devstack cinder-volume[83736]: WARNING cinder.db.sqlalchemy.api [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-782171358'] Sep 17 18:30:50 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['323b6927-6933-4048-a949-0462804d71d2', 'f6902971-7c19-42aa-9dff-f03ee4ca137b', 'be3c2875-9085-47df-9173-f4ff7c6078c3', 'd98e151b-ae82-41b3-9a3d-e6aeeada0cca'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:30:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:30:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:30:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.162s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:51 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:30:51 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-66835659-6ed0-4c10-ae75-3bac51376c96 tempest-GroupSnapshotsTest-1628267147 None] Delete group completed successfully. Sep 17 18:30:52 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4e048e13-2164-4f2c-bbe9-99915b84fee7 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:52 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4e048e13-2164-4f2c-bbe9-99915b84fee7 tempest-GroupSnapshotsTest-1628267147 None] Group tempest-GroupSnapshotsTest-Group-958501958: creating Sep 17 18:30:52 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4e048e13-2164-4f2c-bbe9-99915b84fee7 tempest-GroupSnapshotsTest-1628267147 None] Group tempest-GroupSnapshotsTest-Group-958501958: created successfully Sep 17 18:30:52 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4e048e13-2164-4f2c-bbe9-99915b84fee7 tempest-GroupSnapshotsTest-1628267147 None] Create group completed successfully. Sep 17 18:30:53 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:53 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:30:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Flow 'volume_create_manager' (336131ae-6b13-480e-9140-c1dc485aa84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:30:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17769bab-8d09-4653-ae43-80d4e045cf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17769bab-8d09-4653-ae43-80d4e045cf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1636119042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc9886db-b670-40a2-9bf1-a8ccf13fc4bc,host='devstack@QuobyteHD#QuobyteHD',id=da99bd8b-9451-4c6f-a477-9211c57566c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99e6fcce7b44f1d8214e27375f8cecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:30:54Z,use_quota=True,user_id='511b8715dadb4817a590b02e08256ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9455e03f-1837-4eed-9d82-c9ddfaaf9a94),volume_type_id=9455e03f-1837-4eed-9d82-c9ddfaaf9a94)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786481c6-a875-4833-9385-1607e726fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786481c6-a875-4833-9385-1607e726fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d1b4a9-d31c-48c9-8f4b-212b9873f2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d1b4a9-d31c-48c9-8f4b-212b9873f2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da99bd8b-9451-4c6f-a477-9211c57566c2', 'volume_name': 'volume-da99bd8b-9451-4c6f-a477-9211c57566c2', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20233734-01ac-483b-baf9-d9767b906823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20233734-01ac-483b-baf9-d9767b906823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e454621a-5a08-40bc-b145-aad4b47ebf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:54 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Volume da99bd8b-9451-4c6f-a477-9211c57566c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da99bd8b-9451-4c6f-a477-9211c57566c2', 'volume_size': 1} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc9886db-b670-40a2-9bf1-a8ccf13fc4bc,created_at=2025-09-17T16:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1636119042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc9886db-b670-40a2-9bf1-a8ccf13fc4bc,host='devstack@QuobyteHD#QuobyteHD',id=da99bd8b-9451-4c6f-a477-9211c57566c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99e6fcce7b44f1d8214e27375f8cecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:30:54Z,use_quota=True,user_id='511b8715dadb4817a590b02e08256ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9455e03f-1837-4eed-9d82-c9ddfaaf9a94),volume_type_id=9455e03f-1837-4eed-9d82-c9ddfaaf9a94)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Creating volume da99bd8b-9451-4c6f-a477-9211c57566c2 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:30:54 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:54 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=53, name=volume-da99bd8b-9451-4c6f-a477-9211c57566c2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2 1073741824" returned: 0 in 0.617s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2" returned: 0 in 0.131s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] <== create_volume: return (825ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:30:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e454621a-5a08-40bc-b145-aad4b47ebf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da99bd8b-9451-4c6f-a477-9211c57566c2', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11d09ac-adc0-45f0-abe3-49a7ae2b152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:55 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Volume volume-da99bd8b-9451-4c6f-a477-9211c57566c2 (da99bd8b-9451-4c6f-a477-9211c57566c2): created successfully Sep 17 18:30:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11d09ac-adc0-45f0-abe3-49a7ae2b152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Flow 'volume_create_manager' (336131ae-6b13-480e-9140-c1dc485aa84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:30:55 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-0cdaaef9-2899-40aa-a322-e7eaa86c15d3 tempest-GroupSnapshotsTest-1628267147 None] Created volume successfully. Sep 17 18:30:56 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Flow 'volume_create_manager' (41ad77ae-5c36-472a-9489-3a49074dffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8ceae3-6735-4700-9527-321da40684b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8ceae3-6735-4700-9527-321da40684b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1346654358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc9886db-b670-40a2-9bf1-a8ccf13fc4bc,host='devstack@QuobyteHD#QuobyteHD',id=f7baa37d-bb25-4b9c-b002-9c40685b0986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99e6fcce7b44f1d8214e27375f8cecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:30:57Z,use_quota=True,user_id='511b8715dadb4817a590b02e08256ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9455e03f-1837-4eed-9d82-c9ddfaaf9a94),volume_type_id=9455e03f-1837-4eed-9d82-c9ddfaaf9a94)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3dac49-2cf6-4a30-836d-56fc09c4e1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3dac49-2cf6-4a30-836d-56fc09c4e1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a667e9a5-bf4d-427d-9174-562becebff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a667e9a5-bf4d-427d-9174-562becebff84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7baa37d-bb25-4b9c-b002-9c40685b0986', 'volume_name': 'volume-f7baa37d-bb25-4b9c-b002-9c40685b0986', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5852fee5-12c1-4ea1-97d5-7ecc924d5444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5852fee5-12c1-4ea1-97d5-7ecc924d5444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddd1591-31a3-4c3c-a8c2-70f5eea6289d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:56 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Volume f7baa37d-bb25-4b9c-b002-9c40685b0986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7baa37d-bb25-4b9c-b002-9c40685b0986', 'volume_size': 1} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc9886db-b670-40a2-9bf1-a8ccf13fc4bc,created_at=2025-09-17T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1346654358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc9886db-b670-40a2-9bf1-a8ccf13fc4bc,host='devstack@QuobyteHD#QuobyteHD',id=f7baa37d-bb25-4b9c-b002-9c40685b0986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99e6fcce7b44f1d8214e27375f8cecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:30:57Z,use_quota=True,user_id='511b8715dadb4817a590b02e08256ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9455e03f-1837-4eed-9d82-c9ddfaaf9a94),volume_type_id=9455e03f-1837-4eed-9d82-c9ddfaaf9a94)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Creating volume f7baa37d-bb25-4b9c-b002-9c40685b0986 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:30:56 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:30:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:57 devstack quobyte-client[83739]: System call of process 93261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:30:57 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=54, name=volume-f7baa37d-bb25-4b9c-b002-9c40685b0986, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:30:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 1073741824" returned: 0 in 0.428s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:30:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986" returned: 0 in 0.129s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:30:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] <== create_volume: return (640ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:30:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:30:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddd1591-31a3-4c3c-a8c2-70f5eea6289d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7baa37d-bb25-4b9c-b002-9c40685b0986', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3d0f7a-a17c-4645-967d-fafd40a2524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:30:57 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Volume volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 (f7baa37d-bb25-4b9c-b002-9c40685b0986): created successfully Sep 17 18:30:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3d0f7a-a17c-4645-967d-fafd40a2524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:30:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Flow 'volume_create_manager' (41ad77ae-5c36-472a-9489-3a49074dffd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:30:57 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-67fd2bc2-80e8-49fd-ad08-96251e755ec1 tempest-GroupSnapshotsTest-1628267147 None] Created volume successfully. Sep 17 18:30:59 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-e6165912-529b-4c31-9528-daf1cc4e832a tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:30:59 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-e6165912-529b-4c31-9528-daf1cc4e832a tempest-GroupSnapshotsTest-1628267147 None] Update group completed successfully. Sep 17 18:31:00 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4b7c9726-55bd-4b79-a3b3-6f48be0cdd0b tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:00 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4b7c9726-55bd-4b79-a3b3-6f48be0cdd0b tempest-GroupSnapshotsTest-1628267147 None] Update group completed successfully. Sep 17 18:31:01 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-0392b064-0b7c-48d0-9f19-433c39c980b1 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:02 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-0392b064-0b7c-48d0-9f19-433c39c980b1 tempest-GroupSnapshotsTest-1628267147 None] Update group completed successfully. Sep 17 18:31:03 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-6b527def-3ee7-46ff-b444-cd5166482b2c tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:03 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6b527def-3ee7-46ff-b444-cd5166482b2c tempest-GroupSnapshotsTest-1628267147 None] Update group completed successfully. Sep 17 18:31:04 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] GroupSnapshot 96838103-8a63-486b-a443-e2eca652af17: creating. Sep 17 18:31:04 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Group snapshot 96838103-8a63-486b-a443-e2eca652af17: creating. {{(pid=83736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 17 18:31:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Creating offline snapshot 4d2bc5b6-e06d-485b-9b37-55e7997acc3b of volume da99bd8b-9451-4c6f-a477-9211c57566c2 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:31:04 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfcfba0-14f4-411b-a490-15999894c9f1]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2" returned: 0 in 0.673s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:05 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=55, name=volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:31:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b 1G" returned: 0 in 0.268s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img rebase -u -b volume-da99bd8b-9451-4c6f-a477-9211c57566c2 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img rebase -u -b volume-da99bd8b-9451-4c6f-a477-9211c57566c2 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b" returned: 0 in 0.194s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:31:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b" returned: 0 in 0.168s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:31:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b" returned: 0 in 0.199s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.info" returned: 0 in 0.203s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:31:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.info" returned: 0 in 0.099s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:07 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Creating offline snapshot 581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 of volume f7baa37d-bb25-4b9c-b002-9c40685b0986 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:31:07 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[96206027-2618-453d-9f2d-883bcb1e257e]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986" returned: 0 in 0.604s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:08 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=57, name=volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 1G" returned: 0 in 0.258s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img rebase -u -b volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681" returned: 0 in 0.160s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681" returned: 0 in 0.096s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681" returned: 0 in 0.097s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.info" returned: 0 in 0.130s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:31:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.info" returned: 0 in 0.123s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:09 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-f982e9ae-3f19-415b-8d26-17ae09893cd9 tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 96838103-8a63-486b-a443-e2eca652af17: created successfully Sep 17 18:31:10 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 96838103-8a63-486b-a443-e2eca652af17: deleting Sep 17 18:31:10 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 96838103-8a63-486b-a443-e2eca652af17: deleting {{(pid=83736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 17 18:31:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-da99bd8b-9451-4c6f-a477-9211c57566c2" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-da99bd8b-9451-4c6f-a477-9211c57566c2" acquired by "delete_snapshot" :: waited 0.080s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-4d2bc5b6-e06d-485b-9b37-55e7997acc3b" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-4d2bc5b6-e06d-485b-9b37-55e7997acc3b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Deleting offline snapshot 4d2bc5b6-e06d-485b-9b37-55e7997acc3b of volume da99bd8b-9451-4c6f-a477-9211c57566c2 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:31:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] snapshot_file for this snap is: volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:31:10 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b26c52-78d3-44b5-972d-bccd734df41a]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b" returned: 0 in 0.437s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da99bd8b-9451-4c6f-a477-9211c57566c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:31:11 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4a8211-030b-4a6a-b633-c00a8e0b6ce4]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:11 devstack quobyte-client[83739]: System call of process 93334 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:31:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2" returned: 0 in 0.547s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b" returned: 0 in 0.350s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2.4d2bc5b6-e06d-485b-9b37-55e7997acc3b" returned: 0 in 0.140s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-4d2bc5b6-e06d-485b-9b37-55e7997acc3b" released by "_delete_snapshot" :: held 1.833s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-da99bd8b-9451-4c6f-a477-9211c57566c2" released by "delete_snapshot" :: held 1.863s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-f7baa37d-bb25-4b9c-b002-9c40685b0986" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-f7baa37d-bb25-4b9c-b002-9c40685b0986" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-581bcfda-c265-4e1d-a4ce-5b0b0a5f9681" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-581bcfda-c265-4e1d-a4ce-5b0b0a5f9681" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Deleting offline snapshot 581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 of volume f7baa37d-bb25-4b9c-b002-9c40685b0986 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] snapshot_file for this snap is: volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6698ae-90f0-4038-98bf-10d6994f95a7]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681" returned: 0 in 0.439s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7baa37d-bb25-4b9c-b002-9c40685b0986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:31:13 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a0b4e5-439b-4fed-a689-13572c8e8830]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986" returned: 0 in 0.512s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681" returned: 0 in 0.258s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986.581bcfda-c265-4e1d-a4ce-5b0b0a5f9681" returned: 0 in 0.132s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-581bcfda-c265-4e1d-a4ce-5b0b0a5f9681" released by "_delete_snapshot" :: held 1.689s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:31:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-f7baa37d-bb25-4b9c-b002-9c40685b0986" released by "delete_snapshot" :: held 1.711s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:31:15 devstack cinder-volume[83736]: WARNING cinder.quota [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1560225881 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1560225881, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:31:15 devstack cinder-volume[83736]: WARNING cinder.quota [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1560225881 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1560225881, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:31:15 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['1766f041-314a-4f66-babc-e6b7068fceb2', '8abb710a-a15c-4ce9-a713-ccad53ebcd23', '2d250761-5772-4bc8-96f1-a6f7831c877f', '4e37dcc7-0995-4d65-9803-6241c7557d85'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:31:15 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['8507afb6-3721-4aec-9e7b-9625252b9e16', 'bf4a9fdc-4a1c-4c0a-8dd4-723fea7f0f5b', 'a6b4a5a4-8c73-4ed9-b663-ed19b8554278', '6167d7e1-6ae4-4a3a-aba5-3b710c1f4cc3'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:31:15 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-dfc3d75f-eb01-41fe-a6b0-b536543708f1 tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 96838103-8a63-486b-a443-e2eca652af17: deleted successfully Sep 17 18:31:16 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-da99bd8b-9451-4c6f-a477-9211c57566c2" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-da99bd8b-9451-4c6f-a477-9211c57566c2" acquired by "delete_volume" :: waited 0.042s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:31:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:31:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:31:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:16 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b1d274-aee5-447b-8c0a-c67cdc369887]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.245s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:31:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2" returned: 0 in 0.581s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da99bd8b-9451-4c6f-a477-9211c57566c2" returned: 0 in 0.128s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-da99bd8b-9451-4c6f-a477-9211c57566c2" released by "delete_volume" :: held 1.121s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:31:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-f7baa37d-bb25-4b9c-b002-9c40685b0986" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-f7baa37d-bb25-4b9c-b002-9c40685b0986" acquired by "delete_volume" :: waited 0.037s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:17 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab05ea12-df6f-444c-b6c2-409a3ed7ed76]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986" returned: 0 in 0.802s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f7baa37d-bb25-4b9c-b002-9c40685b0986" returned: 0 in 0.276s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-f7baa37d-bb25-4b9c-b002-9c40685b0986" released by "delete_volume" :: held 1.293s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:31:19 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['ce9c068c-46fb-4305-a7ea-67f611c43879'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:31:19 devstack cinder-volume[83736]: WARNING cinder.quota [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1560225881 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1560225881, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:31:19 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['bee0b429-f904-4e4c-9ab4-3fa6b971b0a1', 'edf40445-be49-495a-851a-a5444b27bec3', '9a2a2379-895e-48c7-b3ab-bbc227f890f6', 'e6a4039b-3d88-450f-8658-6fcf323cb047'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:31:19 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=84,cinder:UPDATE=80,cinder:DELETE=1,cinder:INSERT=14 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:31:19 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=79,cinder:UPDATE=61,cinder:INSERT=17,cinder:DELETE=3 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:31:19 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['0ec3c35a-1e37-444a-9b9d-25b31f776e21', 'abbac1ec-e75d-4945-8b3e-50fe3fbfcd2d', '5bf1151b-08cb-4fda-9c45-90998779c52c', 'db5f03de-d285-4df1-ae26-a71a3e884a94'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:31:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:31:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:31:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.186s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:20 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:31:20 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ef2f981d-a2b4-4809-a1fb-786f3e096426 tempest-GroupSnapshotsTest-1628267147 None] Delete group completed successfully. Sep 17 18:31:21 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-422ca318-2f13-47f0-a5f9-fa600f4e9f86 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:21 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-422ca318-2f13-47f0-a5f9-fa600f4e9f86 tempest-GroupSnapshotsTest-1628267147 None] Group tempest-GroupSnapshotsTest-Group-1617559907: creating Sep 17 18:31:21 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-422ca318-2f13-47f0-a5f9-fa600f4e9f86 tempest-GroupSnapshotsTest-1628267147 None] Group tempest-GroupSnapshotsTest-Group-1617559907: created successfully Sep 17 18:31:21 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-422ca318-2f13-47f0-a5f9-fa600f4e9f86 tempest-GroupSnapshotsTest-1628267147 None] Create group completed successfully. Sep 17 18:31:22 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Flow 'volume_create_manager' (6008a25a-200f-4e65-8cc4-9adcd3d4f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c765ce-b515-4c02-9169-01e172b6a93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c765ce-b515-4c02-9169-01e172b6a93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-659516202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63efaed2-9baf-44c7-b6b1-149a9555437e,host='devstack@QuobyteHD#QuobyteHD',id=75e2a227-b991-4017-b16a-825b7d229491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99e6fcce7b44f1d8214e27375f8cecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:31:22Z,use_quota=True,user_id='511b8715dadb4817a590b02e08256ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f64b490-7075-492f-8107-950e75759b63),volume_type_id=3f64b490-7075-492f-8107-950e75759b63)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b002f223-0117-45af-b367-6edfd4d801aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b002f223-0117-45af-b367-6edfd4d801aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc60f392-8294-4c0c-b982-d7c54e647f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc60f392-8294-4c0c-b982-d7c54e647f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e2a227-b991-4017-b16a-825b7d229491', 'volume_name': 'volume-75e2a227-b991-4017-b16a-825b7d229491', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13b383d-7160-46d4-a88b-f221b6b05b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13b383d-7160-46d4-a88b-f221b6b05b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d498eea4-6338-4537-879c-07b62d7cc27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:22 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Volume 75e2a227-b991-4017-b16a-825b7d229491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e2a227-b991-4017-b16a-825b7d229491', 'volume_size': 1} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63efaed2-9baf-44c7-b6b1-149a9555437e,created_at=2025-09-17T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-659516202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63efaed2-9baf-44c7-b6b1-149a9555437e,host='devstack@QuobyteHD#QuobyteHD',id=75e2a227-b991-4017-b16a-825b7d229491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99e6fcce7b44f1d8214e27375f8cecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:31:22Z,use_quota=True,user_id='511b8715dadb4817a590b02e08256ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f64b490-7075-492f-8107-950e75759b63),volume_type_id=3f64b490-7075-492f-8107-950e75759b63)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Creating volume 75e2a227-b991-4017-b16a-825b7d229491 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:31:22 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:31:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:22 devstack quobyte-client[83739]: System call of process 93368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:31:22 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=59, name=volume-75e2a227-b991-4017-b16a-825b7d229491, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:31:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491 1073741824" returned: 0 in 0.371s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491" returned: 0 in 0.146s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] <== create_volume: return (592ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:31:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.605s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d498eea4-6338-4537-879c-07b62d7cc27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e2a227-b991-4017-b16a-825b7d229491', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe684471-9dbe-443b-b803-16f3565e77a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:23 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Volume volume-75e2a227-b991-4017-b16a-825b7d229491 (75e2a227-b991-4017-b16a-825b7d229491): created successfully Sep 17 18:31:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe684471-9dbe-443b-b803-16f3565e77a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Flow 'volume_create_manager' (6008a25a-200f-4e65-8cc4-9adcd3d4f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:31:23 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d29f3c9f-6c27-4a32-8ef8-2e30e609726a tempest-GroupSnapshotsTest-1628267147 None] Created volume successfully. Sep 17 18:31:25 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] GroupSnapshot 44e25d92-f5b0-4364-b8d9-be9cb862438d: creating. Sep 17 18:31:25 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Group snapshot 44e25d92-f5b0-4364-b8d9-be9cb862438d: creating. {{(pid=83736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 17 18:31:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Creating offline snapshot 61009ede-8e9e-4dd7-a9c7-cdde8e2786ed of volume 75e2a227-b991-4017-b16a-825b7d229491 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:31:25 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d22119-a3f3-46b3-ab92-9c29f3688d57]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491" returned: 0 in 0.513s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:26 devstack quobyte-client[83739]: System call of process 93376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:31:26 devstack quobyte-client[83739]: System call of process 93376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:31:26 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=60, name=volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:31:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed 1G" returned: 0 in 0.292s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img rebase -u -b volume-75e2a227-b991-4017-b16a-825b7d229491 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:26 devstack quobyte-client[83739]: System call of process 93379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:31:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img rebase -u -b volume-75e2a227-b991-4017-b16a-825b7d229491 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed" returned: 0 in 0.178s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:31:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed" returned: 0 in 0.180s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:31:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed" returned: 0 in 0.126s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.info" returned: 0 in 0.151s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:31:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.info" returned: 0 in 0.131s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:28 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-0a661666-4e29-487f-a1bd-c6c55133d058 tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 44e25d92-f5b0-4364-b8d9-be9cb862438d: created successfully Sep 17 18:31:29 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 44e25d92-f5b0-4364-b8d9-be9cb862438d: deleting Sep 17 18:31:29 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 44e25d92-f5b0-4364-b8d9-be9cb862438d: deleting {{(pid=83736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 17 18:31:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-75e2a227-b991-4017-b16a-825b7d229491" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-75e2a227-b991-4017-b16a-825b7d229491" acquired by "delete_snapshot" :: waited 0.134s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-61009ede-8e9e-4dd7-a9c7-cdde8e2786ed" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-61009ede-8e9e-4dd7-a9c7-cdde8e2786ed" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Deleting offline snapshot 61009ede-8e9e-4dd7-a9c7-cdde8e2786ed of volume 75e2a227-b991-4017-b16a-825b7d229491 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:31:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] snapshot_file for this snap is: volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:31:29 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe155b9-ff1c-442e-a160-6b09b605367b]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed" returned: 0 in 0.891s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75e2a227-b991-4017-b16a-825b7d229491(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:31:30 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7379347e-f9c4-410d-8ec3-03af9470b85c]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491" returned: 0 in 0.446s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed" returned: 0 in 0.222s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491.61009ede-8e9e-4dd7-a9c7-cdde8e2786ed" returned: 0 in 0.113s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-61009ede-8e9e-4dd7-a9c7-cdde8e2786ed" released by "_delete_snapshot" :: held 2.107s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:31:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-75e2a227-b991-4017-b16a-825b7d229491" released by "delete_snapshot" :: held 2.147s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:31:31 devstack cinder-volume[83736]: WARNING cinder.quota [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1116593327 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1116593327, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:31:31 devstack cinder-volume[83736]: WARNING cinder.quota [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1116593327 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1116593327, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:31:31 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['a7cbf17b-ea7d-423f-b771-31e335d5e6b1', 'ba57a292-d663-49b5-b5d6-62130da4a47e', '302ef69c-84aa-4075-879a-c6a01d95d35f', 'af042781-9caf-4c8a-8abf-6bd02cf7c8a9'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:31:32 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6cb30898-9219-49ba-95f3-a008e5a6e4ae tempest-GroupSnapshotsTest-1628267147 None] group_snapshot 44e25d92-f5b0-4364-b8d9-be9cb862438d: deleted successfully Sep 17 18:31:32 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "cinder-quobyte-75e2a227-b991-4017-b16a-825b7d229491" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-75e2a227-b991-4017-b16a-825b7d229491" acquired by "delete_volume" :: waited 0.020s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:32 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[169cfe0e-e922-4452-a67a-b0b62b1d0bd1]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491" returned: 0 in 0.458s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-75e2a227-b991-4017-b16a-825b7d229491" returned: 0 in 0.146s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Lock "cinder-quobyte-75e2a227-b991-4017-b16a-825b7d229491" released by "delete_volume" :: held 0.837s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:31:34 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['e2336d2e-4463-47b6-a6c7-716cd17d4765'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:31:34 devstack cinder-volume[83736]: WARNING cinder.quota [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1116593327 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1116593327, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:31:34 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Created reservations ['38c1da39-65ca-4878-b9ae-f9234d8f79af', 'd4624952-ac3a-4071-874a-fdae92184be3', 'e937bad9-74d1-449e-8044-44f3c7e4a930', '4968ca68-2fe7-4bad-8a51-3870736e2b2e'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:31:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:31:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:31:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.097s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:34 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:31:34 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-045ea6f8-2f29-4d88-b5c8-55e933af1e89 tempest-GroupSnapshotsTest-1628267147 None] Delete group completed successfully. Sep 17 18:31:44 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=33,cinder:SELECT=33,cinder:INSERT=7,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:31:44 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=37,cinder:SELECT=26,cinder:INSERT=6 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:31:48 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Flow 'volume_create_manager' (b31ced42-6a2e-4d32-a840-c94d7ce26a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1536a501-ee15-46d8-a029-26c093707c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1536a501-ee15-46d8-a029-26c093707c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1517840398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d732e5-1311-4788-bdf1-15ab5ab16497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6a41c03cb748e6a70c7ef3b32e3ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:31:48Z,use_quota=True,user_id='8331d9a4b0804fc281522c4b43fe2803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67611ae-8953-497b-b3df-e30e587b135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67611ae-8953-497b-b3df-e30e587b135b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce581d49-bfed-4ffc-9b0a-328c64bbaca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce581d49-bfed-4ffc-9b0a-328c64bbaca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d732e5-1311-4788-bdf1-15ab5ab16497', 'volume_name': 'volume-d2d732e5-1311-4788-bdf1-15ab5ab16497', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03966710-1a69-4130-a4b9-f701e57688d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03966710-1a69-4130-a4b9-f701e57688d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a928c14-421d-43b2-9a73-ad3164eddc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:48 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Volume d2d732e5-1311-4788-bdf1-15ab5ab16497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d732e5-1311-4788-bdf1-15ab5ab16497', 'volume_size': 1} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1517840398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d732e5-1311-4788-bdf1-15ab5ab16497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6a41c03cb748e6a70c7ef3b32e3ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:31:48Z,use_quota=True,user_id='8331d9a4b0804fc281522c4b43fe2803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Creating volume d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:31:48 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:31:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:48 devstack quobyte-client[83739]: System call of process 93421 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:31:48 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=62, name=volume-d2d732e5-1311-4788-bdf1-15ab5ab16497, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:31:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 1073741824" returned: 0 in 0.416s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497" returned: 0 in 0.165s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] <== create_volume: return (707ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:31:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a928c14-421d-43b2-9a73-ad3164eddc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d732e5-1311-4788-bdf1-15ab5ab16497', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04be522-ca5d-4a5f-8053-206cbde65cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:31:49 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Volume volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 (d2d732e5-1311-4788-bdf1-15ab5ab16497): created successfully Sep 17 18:31:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04be522-ca5d-4a5f-8053-206cbde65cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:31:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Flow 'volume_create_manager' (b31ced42-6a2e-4d32-a840-c94d7ce26a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:31:49 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-3003fe44-4564-478b-8e82-419b8e1fee5e tempest-SnapshotsActionsTest-630242633 None] Created volume successfully. Sep 17 18:31:50 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Creating offline snapshot 5e61575b-2248-4511-8eaf-815043dcd51f of volume d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:31:50 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2af342-a1e1-44ae-9abe-edbc8d8a3d21]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497" returned: 0 in 0.420s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:51 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=63, name=volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:31:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f 1G" returned: 0 in 0.223s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:51 devstack quobyte-client[83739]: System call of process 93434 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:31:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img rebase -u -b volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.273s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:31:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.213s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:31:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.094s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.info" returned: 0 in 0.106s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:31:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.info" returned: 0 in 0.088s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:52 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-9fcc4623-c03c-4883-9ef4-597a5801d87c tempest-SnapshotsActionsTest-630242633 None] Create snapshot completed successfully Sep 17 18:31:55 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:31:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:31:55 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Creating offline snapshot 9b3fb6c2-dc05-4267-8568-9494738ad452 of volume d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:31:55 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[92765280-2fa1-47b5-8547-5a86de65f181]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.822s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:31:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:57 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=65, name=volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:31:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452 1G" returned: 0 in 0.454s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:57 devstack quobyte-client[83739]: System call of process 93515 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:31:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img rebase -u -b volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452" returned: 0 in 0.309s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:31:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452" returned: 0 in 0.274s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:31:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452" returned: 0 in 0.181s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:31:58 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2f417c61-fe36-42b6-9223-7114c3004bfa tempest-SnapshotsActionsTest-630242633 None] Create snapshot completed successfully Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-9b3fb6c2-dc05-4267-8568-9494738ad452-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-9b3fb6c2-dc05-4267-8568-9494738ad452-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:59 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-quobyte-9b3fb6c2-dc05-4267-8568-9494738ad452" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-9b3fb6c2-dc05-4267-8568-9494738ad452" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Deleting offline snapshot 9b3fb6c2-dc05-4267-8568-9494738ad452 of volume d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] snapshot_file for this snap is: volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f0b107-7df9-4445-9fb1-014d7eef3838]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452" returned: 0 in 0.424s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44182d2-c0ca-4c90-bc0f-f8bd7be338d0]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:31:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.440s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:00 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452" returned: 0 in 0.336s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.9b3fb6c2-dc05-4267-8568-9494738ad452" returned: 0 in 0.149s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-9b3fb6c2-dc05-4267-8568-9494738ad452" released by "_delete_snapshot" :: held 1.760s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" released by "delete_snapshot" :: held 1.796s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:01 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Created reservations ['a7472e4e-6b63-4086-87b3-3c90958f6b61', '89635d14-8ecc-481a-b3c1-1be130e4ea33', 'c13216c3-2291-4417-87f0-262b519a2216', '8d0750b3-d029-42dd-b294-51acf1d48e59'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:32:01 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Delete snapshot completed successfully. Sep 17 18:32:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4b708fa5-6b85-4031-89fc-6b04e6dc7ee8 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-9b3fb6c2-dc05-4267-8568-9494738ad452-delete_snapshot" released by "delete_snapshot" :: held 2.593s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:02 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Creating offline snapshot bef18509-e2a3-42a3-87a3-93ff153465b7 of volume d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:32:02 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4156287-e0b9-410d-b5d0-f2c4afa61c40]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.641s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:03 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:03 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=66, name=volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:32:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7 1G" returned: 0 in 0.311s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:04 devstack quobyte-client[83739]: System call of process 93580 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:32:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img rebase -u -b volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7" returned: 0 in 0.179s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:32:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7" returned: 0 in 0.099s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:32:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7" returned: 0 in 0.102s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.672s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:05 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-af705451-e055-4e81-ba63-1c56d6f16b79 tempest-SnapshotsActionsTest-630242633 None] Create snapshot completed successfully Sep 17 18:32:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-bef18509-e2a3-42a3-87a3-93ff153465b7-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-bef18509-e2a3-42a3-87a3-93ff153465b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:06 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-quobyte-bef18509-e2a3-42a3-87a3-93ff153465b7" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-bef18509-e2a3-42a3-87a3-93ff153465b7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Deleting offline snapshot bef18509-e2a3-42a3-87a3-93ff153465b7 of volume d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:32:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] snapshot_file for this snap is: volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:32:06 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c568c3f-19f2-49f4-aea4-ca3e4e6d669a]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7" returned: 0 in 0.573s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:07 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:07 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2367dbfe-45da-43ed-bd11-a001de6d6b28]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.449s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:07 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7" returned: 0 in 0.488s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bef18509-e2a3-42a3-87a3-93ff153465b7" returned: 0 in 0.111s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:08 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-bef18509-e2a3-42a3-87a3-93ff153465b7" released by "_delete_snapshot" :: held 1.942s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:08 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" released by "delete_snapshot" :: held 1.973s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:08 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Created reservations ['20e8665e-f974-446e-887f-39d1399ac662', '63564f18-58bb-46d9-820c-a85d41150868', 'd92c84a5-4c8d-48c5-8292-d69ef968d238', 'bacc5d49-f49c-4d2f-98eb-0128ccc6d23b'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:32:08 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Delete snapshot completed successfully. Sep 17 18:32:08 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bd809baa-b2bc-4587-90bf-ef63aa4fa1d0 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-bef18509-e2a3-42a3-87a3-93ff153465b7-delete_snapshot" released by "delete_snapshot" :: held 2.416s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:10 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Creating offline snapshot bb6c68a4-b049-4eab-b485-f28e4aaf0a1e of volume d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:32:10 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9191e749-de0b-4e76-a5d1-4cbf5fadbce8]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.383s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:10 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=67, name=volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:32:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e 1G" returned: 0 in 0.322s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img rebase -u -b volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e" returned: 0 in 0.189s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:32:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e" returned: 0 in 0.111s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:32:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e" returned: 0 in 0.082s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.331s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:11 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a18fe488-95cc-492a-9311-51a04ee78a61 tempest-SnapshotsActionsTest-630242633 None] Create snapshot completed successfully Sep 17 18:32:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-bb6c68a4-b049-4eab-b485-f28e4aaf0a1e-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-bb6c68a4-b049-4eab-b485-f28e4aaf0a1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-quobyte-bb6c68a4-b049-4eab-b485-f28e4aaf0a1e" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-bb6c68a4-b049-4eab-b485-f28e4aaf0a1e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Deleting offline snapshot bb6c68a4-b049-4eab-b485-f28e4aaf0a1e of volume d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:32:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] snapshot_file for this snap is: volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:32:12 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d8b033-e883-4294-ada8-19eb02db3546]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e" returned: 0 in 0.477s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:13 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb244828-9cd0-44ef-bcbd-a84c93601aeb]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.428s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:13 devstack quobyte-client[83739]: System call of process 93614 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:32:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e" returned: 0 in 0.337s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.bb6c68a4-b049-4eab-b485-f28e4aaf0a1e" returned: 0 in 0.094s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-bb6c68a4-b049-4eab-b485-f28e4aaf0a1e" released by "_delete_snapshot" :: held 1.677s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" released by "delete_snapshot" :: held 1.702s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:14 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Created reservations ['155dc439-193c-49db-8d0c-1a599210010f', 'd6f994c8-84b4-4801-bd86-37c9a43b1f9f', '5a416c52-b541-4208-9fa6-321f8207d35a', '6a47dd95-51d8-4a9f-8215-75a9bf4248b2'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:32:14 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Delete snapshot completed successfully. Sep 17 18:32:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d27e012-8b06-40b0-8ba5-d23fc87ca82e tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-bb6c68a4-b049-4eab-b485-f28e4aaf0a1e-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:15 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Creating offline snapshot 736514fb-4b67-4644-b358-7c2c266e4be0 of volume d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:32:15 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[385640bb-9f22-46fe-9c13-4fecae9acfcf]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.467s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:15 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=68, name=volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0 1G" returned: 0 in 0.285s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img rebase -u -b volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0" returned: 0 in 0.184s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0" returned: 0 in 0.163s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0" returned: 0 in 0.112s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.473s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.270s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:32:17 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-dc85b37e-79eb-4971-8cf8-d8bc188cd955 tempest-SnapshotsActionsTest-630242633 None] Create snapshot completed successfully Sep 17 18:32:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-736514fb-4b67-4644-b358-7c2c266e4be0-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-736514fb-4b67-4644-b358-7c2c266e4be0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:18 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Acquiring lock "cinder-quobyte-736514fb-4b67-4644-b358-7c2c266e4be0" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-736514fb-4b67-4644-b358-7c2c266e4be0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Deleting offline snapshot 736514fb-4b67-4644-b358-7c2c266e4be0 of volume d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:32:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] snapshot_file for this snap is: volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:32:18 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39c43fc-8aae-44d4-b377-3b7426410ded]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:19 devstack quobyte-client[83739]: System call of process 93633 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:32:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0" returned: 0 in 0.529s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:19 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[505d0c05-a97a-4480-ae22-9d6083d2d781]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.509s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:19 devstack quobyte-client[83739]: System call of process 93645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:32:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0" returned: 0 in 0.264s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.736514fb-4b67-4644-b358-7c2c266e4be0" returned: 0 in 0.102s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-736514fb-4b67-4644-b358-7c2c266e4be0" released by "_delete_snapshot" :: held 1.752s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" released by "delete_snapshot" :: held 1.786s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:20 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Created reservations ['bb434d5f-e0cc-46af-adba-df6082a8f625', '4c7b533c-a6fa-4e15-9ea6-177bdf42b8f0', 'c84c7e00-0215-45f6-b3be-bf78f063bf6a', '5a1b8da6-fcf3-4e93-a10b-fce30f6f0d3a'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:32:20 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Delete snapshot completed successfully. Sep 17 18:32:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2a1eeb62-83fe-435a-bde5-5bc6d6796af9 tempest-SnapshotsActionsTest-566336372 None] Lock "cinder-736514fb-4b67-4644-b358-7c2c266e4be0-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "cinder-5e61575b-2248-4511-8eaf-815043dcd51f-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Lock "cinder-5e61575b-2248-4511-8eaf-815043dcd51f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:22 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "cinder-quobyte-5e61575b-2248-4511-8eaf-815043dcd51f" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Lock "cinder-quobyte-5e61575b-2248-4511-8eaf-815043dcd51f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Deleting offline snapshot 5e61575b-2248-4511-8eaf-815043dcd51f of volume d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:32:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] snapshot_file for this snap is: volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:32:22 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70e4ff8-b756-4abe-ac78-17e56a2ff8fa]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.545s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d732e5-1311-4788-bdf1-15ab5ab16497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:23 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ae3602-8ebd-416d-b6c9-8d0ab3017dce]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497" returned: 0 in 0.419s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:23 devstack quobyte-client[83739]: System call of process 93655 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:32:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.241s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497.5e61575b-2248-4511-8eaf-815043dcd51f" returned: 0 in 0.110s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Lock "cinder-quobyte-5e61575b-2248-4511-8eaf-815043dcd51f" released by "_delete_snapshot" :: held 1.669s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" released by "delete_snapshot" :: held 1.714s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:24 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Created reservations ['e45fce49-e9df-4d33-bdfa-8052b5ac1f75', '836a4ee4-1890-4e5a-8ea0-c64b32e3ff81', '2f987606-1b65-4315-9ee0-066b6ad98def', '0633062d-9c4b-45c6-9b92-47918f745665'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:32:24 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Delete snapshot completed successfully. Sep 17 18:32:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-868eeb9a-073c-4008-b8d5-c4e44d311ab8 tempest-SnapshotsActionsTest-630242633 None] Lock "cinder-5e61575b-2248-4511-8eaf-815043dcd51f-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "cinder-d2d732e5-1311-4788-bdf1-15ab5ab16497-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Lock "cinder-d2d732e5-1311-4788-bdf1-15ab5ab16497-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:25 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:25 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95f24d9-3d00-4fe6-8e50-d985c880c477]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497" returned: 0 in 0.426s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-d2d732e5-1311-4788-bdf1-15ab5ab16497" returned: 0 in 0.107s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Lock "cinder-quobyte-d2d732e5-1311-4788-bdf1-15ab5ab16497" released by "delete_volume" :: held 0.695s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:26 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Created reservations ['056daef7-4c47-40ca-845f-7042a3731227', '722a5748-5e41-46c6-bdb2-2f0059cc75a9', '9403ef69-0b34-4ec0-b611-3c49836b670b', '6d4c7268-bcdf-4f17-a2e9-67e41c45acb0'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:32:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:32:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:32:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.094s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:27 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:32:27 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Deleted volume successfully. Sep 17 18:32:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8135e27a-620c-4a31-bddb-d7f2e84fb7b4 tempest-SnapshotsActionsTest-630242633 None] Lock "cinder-d2d732e5-1311-4788-bdf1-15ab5ab16497-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:33 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:32:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Flow 'volume_create_manager' (298978ea-909f-41c5-9f80-a87173d9815f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:32:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae9d1c8-bf9d-451c-bd0c-d9655ef2962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae9d1c8-bf9d-451c-bd0c-d9655ef2962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1314920669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2479cf38-7eb5-4fb3-80ff-bc6d63e7e612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba39db73c5c4971829e3e125d69a645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:32:34Z,use_quota=True,user_id='283ea8d774544776978dd871cd7fcdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff15399-80d8-4e26-aa1b-0fcf2b075a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff15399-80d8-4e26-aa1b-0fcf2b075a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbda279d-a1d7-4397-a571-e62324d851a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbda279d-a1d7-4397-a571-e62324d851a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2479cf38-7eb5-4fb3-80ff-bc6d63e7e612', 'volume_name': 'volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33d2b0d-db24-4e2a-b8c6-ffab35fed005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33d2b0d-db24-4e2a-b8c6-ffab35fed005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f976f59-3cf0-47b6-b73f-7f2c35187957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:34 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Volume 2479cf38-7eb5-4fb3-80ff-bc6d63e7e612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612', 'volume_size': 1} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1314920669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2479cf38-7eb5-4fb3-80ff-bc6d63e7e612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba39db73c5c4971829e3e125d69a645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:32:34Z,use_quota=True,user_id='283ea8d774544776978dd871cd7fcdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Creating volume 2479cf38-7eb5-4fb3-80ff-bc6d63e7e612 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:32:34 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:34 devstack quobyte-client[83739]: System call of process 93686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:32:34 devstack quobyte-client[83739]: System call of process 93686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:32:34 devstack quobyte-client[83739]: System call of process 93686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:32:34 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=69, name=volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612 1073741824" returned: 0 in 0.334s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612" returned: 0 in 0.130s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] <== create_volume: return (567ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.581s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f976f59-3cf0-47b6-b73f-7f2c35187957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d9ccba-5fab-4075-9c2c-cff96bb7f1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:34 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Volume volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612 (2479cf38-7eb5-4fb3-80ff-bc6d63e7e612): created successfully Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d9ccba-5fab-4075-9c2c-cff96bb7f1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Flow 'volume_create_manager' (298978ea-909f-41c5-9f80-a87173d9815f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:32:34 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-308729bb-f8b6-4edc-a603-3793339e9f88 tempest-VolumesServicesTestJSON-20370781 None] Created volume successfully. Sep 17 18:32:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Acquiring lock "cinder-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Lock "cinder-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:36 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Acquiring lock "cinder-quobyte-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Lock "cinder-quobyte-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:36 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ef2566-e480-466f-8057-3bab6aa17ef0]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612" returned: 0 in 0.462s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612" returned: 0 in 0.248s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Lock "cinder-quobyte-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612" released by "delete_volume" :: held 0.844s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:37 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Created reservations ['c2cc2b37-4add-417c-8b40-6c1d7a5e8eae', '734b954b-8928-4c92-89e0-28cdaea57b31', '08ef2364-7fd8-4e6d-8004-4280abd765ee', '0c0a5a3e-f710-4cba-9f4a-bdc91d87a3ec'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:32:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:32:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:32:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.090s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:37 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:32:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Deleted volume successfully. Sep 17 18:32:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2c0e622b-e3d3-4a10-8f8d-f05a76682009 tempest-VolumesServicesTestJSON-20370781 None] Lock "cinder-2479cf38-7eb5-4fb3-80ff-bc6d63e7e612-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Flow 'volume_create_manager' (dace5274-1d3c-4269-93a2-984cda4ce9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a6645f-581f-4dca-83f8-dd7c3c4f4951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a6645f-581f-4dca-83f8-dd7c3c4f4951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-493100130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706acd43-9807-480b-a656-6b9f12ecf789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e7f33a9b4f4faa94d106040f840624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:32:43Z,use_quota=True,user_id='2a4a579329154e97941fda6e776ba857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273b4789-720e-414e-8231-4f9186a5d1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273b4789-720e-414e-8231-4f9186a5d1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd15bd25-7c17-4743-afcd-b913c9b321c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd15bd25-7c17-4743-afcd-b913c9b321c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '706acd43-9807-480b-a656-6b9f12ecf789', 'volume_name': 'volume-706acd43-9807-480b-a656-6b9f12ecf789', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695a0e40-54ba-46bc-933f-21d1ea27dea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695a0e40-54ba-46bc-933f-21d1ea27dea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cb7029-8b85-4d73-9032-0c3c13b3195e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:43 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Volume 706acd43-9807-480b-a656-6b9f12ecf789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-706acd43-9807-480b-a656-6b9f12ecf789', 'volume_size': 1} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-493100130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706acd43-9807-480b-a656-6b9f12ecf789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e7f33a9b4f4faa94d106040f840624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:32:43Z,use_quota=True,user_id='2a4a579329154e97941fda6e776ba857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Creating volume 706acd43-9807-480b-a656-6b9f12ecf789 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:32:43 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:43 devstack quobyte-client[83739]: System call of process 93695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:32:43 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=70, name=volume-706acd43-9807-480b-a656-6b9f12ecf789, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:32:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789 1073741824" returned: 0 in 0.331s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789" returned: 0 in 0.086s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] <== create_volume: return (485ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:32:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.501s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cb7029-8b85-4d73-9032-0c3c13b3195e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-706acd43-9807-480b-a656-6b9f12ecf789', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc95c34-94f5-468c-a2cb-1a06fee2b816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:32:44 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Volume volume-706acd43-9807-480b-a656-6b9f12ecf789 (706acd43-9807-480b-a656-6b9f12ecf789): created successfully Sep 17 18:32:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc95c34-94f5-468c-a2cb-1a06fee2b816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:32:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Flow 'volume_create_manager' (dace5274-1d3c-4269-93a2-984cda4ce9ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:32:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-166c8cac-6aed-4dd1-a510-032c4f21fc9a tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Created volume successfully. Sep 17 18:32:45 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=47,cinder:UPDATE=47,cinder:DELETE=6,cinder:INSERT=13 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:32:45 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=63,cinder:DELETE=4,cinder:SELECT=40,cinder:INSERT=15 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:32:45 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Creating offline snapshot 7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 of volume 706acd43-9807-480b-a656-6b9f12ecf789 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:32:45 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[74337ca8-3aea-4048-9b34-be8b608f881b]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789" returned: 0 in 0.458s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:46 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=71, name=volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:32:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 1G" returned: 0 in 0.229s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): qemu-img rebase -u -b volume-706acd43-9807-480b-a656-6b9f12ecf789 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "qemu-img rebase -u -b volume-706acd43-9807-480b-a656-6b9f12ecf789 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87" returned: 0 in 0.179s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:32:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87" returned: 0 in 0.111s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:32:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87" returned: 0 in 0.131s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.info" returned: 0 in 0.116s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:32:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.info" returned: 0 in 0.116s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.722s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:47 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7b496ff4-3d7b-4722-88b7-af5e5a9ee903 tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Create snapshot completed successfully Sep 17 18:32:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Acquiring lock "cinder-7d54dcff-b418-42c4-ab1f-8e1ebaffdc87-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "cinder-7d54dcff-b418-42c4-ab1f-8e1ebaffdc87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:50 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Acquiring lock "cinder-quobyte-706acd43-9807-480b-a656-6b9f12ecf789" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "cinder-quobyte-706acd43-9807-480b-a656-6b9f12ecf789" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Acquiring lock "cinder-quobyte-7d54dcff-b418-42c4-ab1f-8e1ebaffdc87" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "cinder-quobyte-7d54dcff-b418-42c4-ab1f-8e1ebaffdc87" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Deleting offline snapshot 7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 of volume 706acd43-9807-480b-a656-6b9f12ecf789 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] snapshot_file for this snap is: volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d95ce1-0944-4eab-be9b-f2a41c943e83]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87" returned: 0 in 0.715s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-706acd43-9807-480b-a656-6b9f12ecf789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[468cfac8-10e8-4e8a-bd1e-06cc7abf3787]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789" returned: 0 in 0.467s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87" returned: 0 in 0.229s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789.7d54dcff-b418-42c4-ab1f-8e1ebaffdc87" returned: 0 in 0.248s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "cinder-quobyte-7d54dcff-b418-42c4-ab1f-8e1ebaffdc87" released by "_delete_snapshot" :: held 2.120s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "cinder-quobyte-706acd43-9807-480b-a656-6b9f12ecf789" released by "delete_snapshot" :: held 2.150s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:52 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Created reservations ['2207fcf4-352e-466b-be1a-6de795f4dd39', '2ea4afab-7316-46e9-8d00-9612b903f3e7', 'd7870713-8e5e-4918-9493-ca5efd67e09d', '32b3713e-e374-41f4-9e03-35aac57778dc'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:32:52 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Delete snapshot completed successfully. Sep 17 18:32:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ab8997c2-5af9-4b88-a0e7-d3631d81a2ea tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "cinder-7d54dcff-b418-42c4-ab1f-8e1ebaffdc87-delete_snapshot" released by "delete_snapshot" :: held 2.690s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:53 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Acquiring lock "cinder-706acd43-9807-480b-a656-6b9f12ecf789-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:53 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "cinder-706acd43-9807-480b-a656-6b9f12ecf789-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:53 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:32:53 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Acquiring lock "cinder-quobyte-706acd43-9807-480b-a656-6b9f12ecf789" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:32:53 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "cinder-quobyte-706acd43-9807-480b-a656-6b9f12ecf789" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:32:53 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bda0abf-730b-42d8-966f-1ee012f1fec4]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:32:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789" returned: 0 in 0.457s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-706acd43-9807-480b-a656-6b9f12ecf789" returned: 0 in 0.098s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "cinder-quobyte-706acd43-9807-480b-a656-6b9f12ecf789" released by "delete_volume" :: held 0.741s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:32:54 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Created reservations ['3d171233-292e-4f64-8c36-f95ad99e9d5d', '1c38f91c-069d-4ef2-91b7-e335bb0605e8', '49f17084-3047-456d-9216-24152001fc33', '7e14a98f-d52f-42fd-a67b-962a29cb1556'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:32:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:32:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:32:55 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:32:55 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:32:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:32:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:32:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.102s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:32:55 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:32:55 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Deleted volume successfully. Sep 17 18:32:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d447e99-12e1-4934-9dc0-d552d413c3ec tempest-VolumeSnapshotQuotasNegativeTestJSON-294525625 None] Lock "cinder-706acd43-9807-480b-a656-6b9f12ecf789-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:33:04 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Flow 'volume_create_manager' (679d0990-1737-46e7-919f-65a87e87f3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b1ecfb-bc80-4373-8d17-598435046e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b1ecfb-bc80-4373-8d17-598435046e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-245400789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056fee5b0ca4411185dc9eb445758b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:33:04Z,use_quota=True,user_id='7baab7a8fe414979be86aae8fa126cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7351f905-f0ee-4f2b-a88d-0e0a40cffc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7351f905-f0ee-4f2b-a88d-0e0a40cffc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb64fd2c-e680-47a9-be4e-ae93c3ec3a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.image.glance [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Creating Keystone auth plugin from conf {{(pid=83736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb64fd2c-e680-47a9-be4e-ae93c3ec3a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1', 'volume_name': 'volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a596fea1-454d-49c5-80d8-d6129c081947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a596fea1-454d-49c5-80d8-d6129c081947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473aefcc-6911-442a-b1ac-cdea616a7bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:04 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Volume 84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 18:33:04 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Cloning 84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 from image 9006947d-67cc-459e-820f-320733203bdb at location (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]). {{(pid=83736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 17 18:33:05 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 18:33:05 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Image download 20.69 MB at 20.69 MB/s Sep 17 18:33:05 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[76574ca7-0aa4-4957-9658-ddc4722dd2fe]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:33:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:06 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD Sep 17 18:33:06 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:33:07 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Sep 17 18:33:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD" returned: 0 in 2.231s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:07 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Temporary image 9006947d-67cc-459e-820f-320733203bdb is fetched for user 7baab7a8fe414979be86aae8fa126cdf. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 18:33:08 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[873aa6bd-22ab-4059-9a8b-419eceeccf86]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:33:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:08 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD Sep 17 18:33:08 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:33:10 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD" returned: 0 in 2.350s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-245400789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056fee5b0ca4411185dc9eb445758b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:33:04Z,use_quota=True,user_id='7baab7a8fe414979be86aae8fa126cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Creating volume 84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:33:10 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:33:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:10 devstack quobyte-client[83739]: System call of process 93804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:33:10 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=73, name=volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 1073741824" returned: 0 in 0.558s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:11 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Flow 'volume_create_manager' (eb75a889-b6a4-4ef3-8d39-b51c27984e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65968a0-2a9d-455e-9bf8-93ac80892ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1" returned: 0 in 0.382s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] <== create_volume: return (998ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65968a0-2a9d-455e-9bf8-93ac80892ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1677708389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d6540d-eff1-40a9-86f1-675d10160ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152a1ce2729142418256b2b081f293a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:33:11Z,use_quota=True,user_id='237df8f1e7fe45eb94538509b7c918dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0bd55a-7484-49b4-8f30-35b4e61db631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0bd55a-7484-49b4-8f30-35b4e61db631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4336f3-38f0-4a14-b531-1793212328ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4336f3-38f0-4a14-b531-1793212328ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6d6540d-eff1-40a9-86f1-675d10160ecb', 'volume_name': 'volume-e6d6540d-eff1-40a9-86f1-675d10160ecb', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cfe946-8e66-45e4-b922-5c11ca5dbbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cfe946-8e66-45e4-b922-5c11ca5dbbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f101ee-5a07-4256-bb0e-85cf957323b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:11 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Volume e6d6540d-eff1-40a9-86f1-675d10160ecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6d6540d-eff1-40a9-86f1-675d10160ecb', 'volume_size': 1} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1677708389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d6540d-eff1-40a9-86f1-675d10160ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152a1ce2729142418256b2b081f293a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:33:11Z,use_quota=True,user_id='237df8f1e7fe45eb94538509b7c918dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Creating volume e6d6540d-eff1-40a9-86f1-675d10160ecb {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:33:11 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-e6d6540d-eff1-40a9-86f1-675d10160ecb 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:11 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=74, name=volume-e6d6540d-eff1-40a9-86f1-675d10160ecb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:33:11 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Attempting download of 9006947d-67cc-459e-820f-320733203bdb ((None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}])) to volume 84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-e6d6540d-eff1-40a9-86f1-675d10160ecb 1073741824" returned: 0 in 0.487s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-e6d6540d-eff1-40a9-86f1-675d10160ecb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-e6d6540d-eff1-40a9-86f1-675d10160ecb" returned: 0 in 0.208s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] <== create_volume: return (733ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0c9065-4d19-447c-af2e-74939f9eb18f]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_jpduerwu {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f101ee-5a07-4256-bb0e-85cf957323b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d6540d-eff1-40a9-86f1-675d10160ecb', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d581daf1-a12b-4c71-9507-f54076922697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:12 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Volume volume-e6d6540d-eff1-40a9-86f1-675d10160ecb (e6d6540d-eff1-40a9-86f1-675d10160ecb): created successfully Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d581daf1-a12b-4c71-9507-f54076922697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Flow 'volume_create_manager' (eb75a889-b6a4-4ef3-8d39-b51c27984e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:33:12 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c769ca8f-22a1-45ec-bb6a-8e45257cda0d tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Created volume successfully. Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_jpduerwu" returned: 0 in 0.467s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_jpduerwu {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_jpduerwu" returned: 1 in 0.399s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_jpduerwu' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:33:13 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2c960b-79ab-4d61-9194-c256966e7a3d]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:33:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:13 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] 9006947d-67cc-459e-820f-320733203bdb was qcow2, converting to raw {{(pid=83736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 18:33:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:14 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=73, name=volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:33:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1" returned: 0 in 0.869s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:14 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb__25aw7qldevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:33:14 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Converted 112.00 MB image at 112.00 MB/s Sep 17 18:33:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 1G" returned: 0 in 0.168s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:15 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d509434-bb62-480c-8f8e-717d0724fcdd]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:33:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1" returned: 0 in 0.370s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1" returned: 1 in 0.377s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:33:15 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Downloaded image 9006947d-67cc-459e-820f-320733203bdb ((None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}])) to volume 84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 successfully. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 18:33:15 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Temporary image 9006947d-67cc-459e-820f-320733203bdb for user 7baab7a8fe414979be86aae8fa126cdf is deleted. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 18:33:15 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Marking volume 84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 as bootable. {{(pid=83736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Copying metadata from image 9006947d-67cc-459e-820f-320733203bdb to 84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1. {{(pid=83736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Creating volume glance metadata for volume 84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 backed by image 9006947d-67cc-459e-820f-320733203bdb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473aefcc-6911-442a-b1ac-cdea616a7bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49d1daa-ee59-4001-80bd-d32f9fb187a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:16 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Volume volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 (84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1): created successfully Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49d1daa-ee59-4001-80bd-d32f9fb187a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Flow 'volume_create_manager' (679d0990-1737-46e7-919f-65a87e87f3b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:33:16 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-80bad1dd-8c9f-4261-a4e5-dcaa53ed4caa tempest-VolumesImageMetadata-511402529 None] Created volume successfully. Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.248s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:33:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Acquiring lock "cinder-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:33:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Lock "cinder-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1-delete_volume" acquired by "delete_volume" :: waited 0.228s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:33:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-d639ef9e-4b31-41af-a22f-fb0a542c871f req-c73471d2-d37e-43e5-a215-8968a2c80698 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-d639ef9e-4b31-41af-a22f-fb0a542c871f req-c73471d2-d37e-43e5-a215-8968a2c80698 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:17 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab55493-2342-41f0-85ff-db2a7c16d538]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:33:17 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Acquiring lock "cinder-quobyte-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:33:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-d639ef9e-4b31-41af-a22f-fb0a542c871f req-c73471d2-d37e-43e5-a215-8968a2c80698 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-e6d6540d-eff1-40a9-86f1-675d10160ecb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Lock "cinder-quobyte-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1" acquired by "delete_volume" :: waited 0.220s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:33:18 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c1290f-9d6e-41c3-b121-4dec4553e39a]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:33:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-d639ef9e-4b31-41af-a22f-fb0a542c871f req-c73471d2-d37e-43e5-a215-8968a2c80698 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-e6d6540d-eff1-40a9-86f1-675d10160ecb" returned: 0 in 0.507s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-d639ef9e-4b31-41af-a22f-fb0a542c871f req-c73471d2-d37e-43e5-a215-8968a2c80698 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.648s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1" returned: 0 in 0.547s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-d639ef9e-4b31-41af-a22f-fb0a542c871f req-c73471d2-d37e-43e5-a215-8968a2c80698 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-e6d6540d-eff1-40a9-86f1-675d10160ecb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b84f2240-e030-4ca3-9c91-7266e10f50d7', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:33:19 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-d639ef9e-4b31-41af-a22f-fb0a542c871f req-c73471d2-d37e-43e5-a215-8968a2c80698 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1" returned: 1 in 0.526s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1" returned: 0 in 0.297s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Lock "cinder-quobyte-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1" released by "delete_volume" :: held 1.534s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:33:19 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-d639ef9e-4b31-41af-a22f-fb0a542c871f req-c73471d2-d37e-43e5-a215-8968a2c80698 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] attachment_update completed successfully. Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Created reservations ['d438880b-e47f-4244-8ba8-8e90579e380d', 'bea455c3-66ea-4f28-8504-c89cd3d06524', '9276f3f2-d69f-4500-8df5-970df73a897c', '48e50fdf-344d-48c7-b938-7a3ff86eb838'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.088s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:20 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:33:20 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Deleted volume successfully. Sep 17 18:33:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-189d28cc-393e-44e1-b957-4d345328b9c5 tempest-VolumesImageMetadata-511402529 None] Lock "cinder-84ba62e7-0f70-4c08-9cf6-7a3b7c989dc1-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:33:27 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Flow 'volume_create_manager' (11fd49ab-9532-47cf-a57b-80b573becfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e11aa5-b16b-42d6-af17-f0dd92db053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e11aa5-b16b-42d6-af17-f0dd92db053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-747508442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03d57095b1b4ca289e58b0405861d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:33:27Z,use_quota=True,user_id='b21e4fe84ca947789d6d0d63382607f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4fd41d-0595-4568-b4c1-705cd1160441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4fd41d-0595-4568-b4c1-705cd1160441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678b4b00-bb39-47da-8b79-0789f4c68a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678b4b00-bb39-47da-8b79-0789f4c68a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb', 'volume_name': 'volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0033a392-8b0d-42a5-a028-48ce31d4f672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0033a392-8b0d-42a5-a028-48ce31d4f672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0560ad-36b6-481d-a799-4eb514c2ce28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:27 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Volume a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb', 'volume_size': 1} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-747508442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03d57095b1b4ca289e58b0405861d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:33:27Z,use_quota=True,user_id='b21e4fe84ca947789d6d0d63382607f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Creating volume a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:33:27 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:27 devstack quobyte-client[83739]: System call of process 94247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:33:27 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=75, name=volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb 1073741824" returned: 0 in 0.362s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb" returned: 0 in 0.095s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] <== create_volume: return (533ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:33:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.545s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0560ad-36b6-481d-a799-4eb514c2ce28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd059cc7-e53f-4aba-ba6a-bcebeb7a22dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:28 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Volume volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb (a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb): created successfully Sep 17 18:33:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd059cc7-e53f-4aba-ba6a-bcebeb7a22dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Flow 'volume_create_manager' (11fd49ab-9532-47cf-a57b-80b573becfd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:33:28 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d72bb8e8-b8c4-448d-b889-5067c79e33f4 tempest-VolumesMetadataTest-1117399495 None] Created volume successfully. Sep 17 18:33:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Acquiring lock "cinder-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:33:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Lock "cinder-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:33:30 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Acquiring lock "cinder-quobyte-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:33:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Lock "cinder-quobyte-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:33:30 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aee89f-9565-44c0-841b-64002ad27882]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:33:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb" returned: 0 in 0.392s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb" returned: 0 in 0.104s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Lock "cinder-quobyte-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb" released by "delete_volume" :: held 0.636s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:33:31 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Created reservations ['71e57871-c531-40cb-81d0-fac1537385a1', '4be18b2b-4648-4568-be1c-80617c08afd3', '08f46e69-306b-43d1-8dab-dd5547f48953', '4a7dc5c6-671d-49c2-8efc-9ec56ff498cb'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:33:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:33:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:33:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.112s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:31 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:33:31 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Deleted volume successfully. Sep 17 18:33:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6b9de91c-1937-4e13-a571-6472aae8173e tempest-VolumesMetadataTest-1117399495 None] Lock "cinder-a0f05a3c-8211-4d88-93c4-6b10e4a1e0bb-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:33:37 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Flow 'volume_create_manager' (b30d7fdf-9aa9-47dc-b458-5250e1b95ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92cf82dc-3f97-4db8-9ab9-240236b7cad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92cf82dc-3f97-4db8-9ab9-240236b7cad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-66815520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3fc5a9-6833-4b0a-961f-17e3a49fb149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9caa9ee0b2124957b597f46ac60e900e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:33:37Z,use_quota=True,user_id='00b6c1fa83d443718fcae961f3ed4935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fea0af9-d30a-4638-8426-6dffca5f8074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fea0af9-d30a-4638-8426-6dffca5f8074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9386149-3bac-4533-881f-b466e5b45b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9386149-3bac-4533-881f-b466e5b45b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a3fc5a9-6833-4b0a-961f-17e3a49fb149', 'volume_name': 'volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6932bfd4-1372-4bd2-86ae-8e9afe5e818b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6932bfd4-1372-4bd2-86ae-8e9afe5e818b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91293c6c-3f39-4722-8d80-08861c30f588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:37 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Volume 5a3fc5a9-6833-4b0a-961f-17e3a49fb149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149', 'volume_size': 1} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-66815520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3fc5a9-6833-4b0a-961f-17e3a49fb149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9caa9ee0b2124957b597f46ac60e900e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:33:37Z,use_quota=True,user_id='00b6c1fa83d443718fcae961f3ed4935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Creating volume 5a3fc5a9-6833-4b0a-961f-17e3a49fb149 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:33:37 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:37 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=76, name=volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149 1073741824" returned: 0 in 0.373s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149" returned: 0 in 0.084s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] <== create_volume: return (515ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:33:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.526s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91293c6c-3f39-4722-8d80-08861c30f588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dbd07c-43c9-4f4f-8313-de924514e8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:38 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Volume volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149 (5a3fc5a9-6833-4b0a-961f-17e3a49fb149): created successfully Sep 17 18:33:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dbd07c-43c9-4f4f-8313-de924514e8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Flow 'volume_create_manager' (b30d7fdf-9aa9-47dc-b458-5250e1b95ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:33:38 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-5b87f9bd-f382-4e08-a614-c4b3b671bc81 tempest-VolumesTransfersV357Test-466450511 None] Created volume successfully. Sep 17 18:33:38 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-08489518-0b36-44d6-805c-70890cf46b19 req-c303b0f4-db87-4735-8ba9-d4dabd7f66c7 tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:38 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-08489518-0b36-44d6-805c-70890cf46b19 req-c303b0f4-db87-4735-8ba9-d4dabd7f66c7 tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:38 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-08489518-0b36-44d6-805c-70890cf46b19 req-c303b0f4-db87-4735-8ba9-d4dabd7f66c7 tempest-AttachVolumeTestJSON-315441114 None] Terminate volume connection completed successfully. Sep 17 18:33:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-08489518-0b36-44d6-805c-70890cf46b19 req-c303b0f4-db87-4735-8ba9-d4dabd7f66c7 tempest-AttachVolumeTestJSON-315441114 None] Deleting attachment 69f8a16f-0a49-4c37-88e4-254099cb5cab. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:33:39 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-fa8789c0-37b2-47de-a807-0a9c2da87703 tempest-VolumesTransfersV357Test-967616706 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-fa8789c0-37b2-47de-a807-0a9c2da87703 tempest-VolumesTransfersV357Test-967616706 None] Transfer volume completed successfully. Sep 17 18:33:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Acquiring lock "cinder-5a3fc5a9-6833-4b0a-961f-17e3a49fb149-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:33:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Lock "cinder-5a3fc5a9-6833-4b0a-961f-17e3a49fb149-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:33:40 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Acquiring lock "cinder-quobyte-5a3fc5a9-6833-4b0a-961f-17e3a49fb149" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:33:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Lock "cinder-quobyte-5a3fc5a9-6833-4b0a-961f-17e3a49fb149" acquired by "delete_volume" :: waited 0.014s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:33:41 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6963f0e-00ca-420d-a21e-f60b9c5271b2]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:33:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149" returned: 0 in 0.426s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5a3fc5a9-6833-4b0a-961f-17e3a49fb149" returned: 0 in 0.110s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Lock "cinder-quobyte-5a3fc5a9-6833-4b0a-961f-17e3a49fb149" released by "delete_volume" :: held 0.687s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:33:41 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Created reservations ['9e2c1a18-e6ab-47d7-96c6-48a6352a3aa1', 'bc038feb-46d5-44c7-825a-fe13169874c5', 'f60d9d66-5fca-42b2-b63c-ca537cca7656', '8d47646b-bb35-4916-ada8-1d6691c19ce9'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:33:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:33:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:33:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.127s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:42 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:33:42 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Deleted volume successfully. Sep 17 18:33:42 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9714e0f4-5203-46cb-8329-fd2784863a6d tempest-VolumesTransfersV357Test-1694159184 None] Lock "cinder-5a3fc5a9-6833-4b0a-961f-17e3a49fb149-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:33:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:43 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Flow 'volume_create_manager' (9c22d596-3853-4e9a-84ec-e085bf866d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371f18ac-8eeb-4621-aed8-f5e65a85ceb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371f18ac-8eeb-4621-aed8-f5e65a85ceb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1392907852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02972d0-8584-4547-9812-a29f72990379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9caa9ee0b2124957b597f46ac60e900e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:33:44Z,use_quota=True,user_id='00b6c1fa83d443718fcae961f3ed4935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16ed92b-45c4-4fad-b127-b38ad3f21f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16ed92b-45c4-4fad-b127-b38ad3f21f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14204dc5-db56-40ea-9515-ab224846ed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14204dc5-db56-40ea-9515-ab224846ed9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02972d0-8584-4547-9812-a29f72990379', 'volume_name': 'volume-c02972d0-8584-4547-9812-a29f72990379', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672280f4-5dd5-4729-bf26-8854ec05af20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672280f4-5dd5-4729-bf26-8854ec05af20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c6617a-1f50-4955-a86b-f190a0332f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:44 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Volume c02972d0-8584-4547-9812-a29f72990379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02972d0-8584-4547-9812-a29f72990379', 'volume_size': 1} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1392907852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02972d0-8584-4547-9812-a29f72990379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9caa9ee0b2124957b597f46ac60e900e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:33:44Z,use_quota=True,user_id='00b6c1fa83d443718fcae961f3ed4935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Creating volume c02972d0-8584-4547-9812-a29f72990379 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:33:44 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c02972d0-8584-4547-9812-a29f72990379 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:44 devstack quobyte-client[83739]: System call of process 94299 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:33:44 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=77, name=volume-c02972d0-8584-4547-9812-a29f72990379, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c02972d0-8584-4547-9812-a29f72990379 1073741824" returned: 0 in 0.478s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c02972d0-8584-4547-9812-a29f72990379 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c02972d0-8584-4547-9812-a29f72990379" returned: 0 in 0.154s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] <== create_volume: return (763ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:33:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c6617a-1f50-4955-a86b-f190a0332f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02972d0-8584-4547-9812-a29f72990379', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5278fb-1b52-4a40-bb8d-3675a17bcad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:33:45 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Volume volume-c02972d0-8584-4547-9812-a29f72990379 (c02972d0-8584-4547-9812-a29f72990379): created successfully Sep 17 18:33:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5278fb-1b52-4a40-bb8d-3675a17bcad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:33:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Flow 'volume_create_manager' (9c22d596-3853-4e9a-84ec-e085bf866d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:33:45 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-03b2ef63-728c-4cb4-82f4-76f677a1a7b3 tempest-VolumesTransfersV357Test-466450511 None] Created volume successfully. Sep 17 18:33:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Acquiring lock "cinder-c02972d0-8584-4547-9812-a29f72990379-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:33:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Lock "cinder-c02972d0-8584-4547-9812-a29f72990379-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:33:46 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=42,cinder:DELETE=6,cinder:INSERT=13,cinder:UPDATE=44 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:33:46 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=60,cinder:SELECT=50,cinder:INSERT=20,cinder:DELETE=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:33:46 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Acquiring lock "cinder-quobyte-c02972d0-8584-4547-9812-a29f72990379" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:33:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Lock "cinder-quobyte-c02972d0-8584-4547-9812-a29f72990379" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:33:46 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[681b70f7-2a59-41b6-b580-a7a8a0b02dc7]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:33:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c02972d0-8584-4547-9812-a29f72990379 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c02972d0-8584-4547-9812-a29f72990379" returned: 0 in 0.450s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c02972d0-8584-4547-9812-a29f72990379 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c02972d0-8584-4547-9812-a29f72990379" returned: 0 in 0.103s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:47 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Lock "cinder-quobyte-c02972d0-8584-4547-9812-a29f72990379" released by "delete_volume" :: held 0.723s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:33:47 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Created reservations ['150ccc77-ed35-412b-b52d-3115fd74aaae', '9e4d2754-c9a7-4429-aa12-49a51cec8556', 'a970062b-c677-4f12-8f7b-e10a9eae2525', '1bc84dd2-19e5-4c68-9825-736c9b0a7faa'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:33:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:33:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:33:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.107s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:48 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:33:48 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Deleted volume successfully. Sep 17 18:33:48 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d5c3eb41-5113-4be9-813c-467e2248f805 tempest-VolumesTransfersV357Test-1694159184 None] Lock "cinder-c02972d0-8584-4547-9812-a29f72990379-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:33:49 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-66efae09-0b4e-41d5-90bd-9b1ac342a512 req-b27f6023-e06b-443a-a8ca-c010fc4a3474 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:49 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-66efae09-0b4e-41d5-90bd-9b1ac342a512 req-b27f6023-e06b-443a-a8ca-c010fc4a3474 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:49 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-66efae09-0b4e-41d5-90bd-9b1ac342a512 req-b27f6023-e06b-443a-a8ca-c010fc4a3474 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Terminate volume connection completed successfully. Sep 17 18:33:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-66efae09-0b4e-41d5-90bd-9b1ac342a512 req-b27f6023-e06b-443a-a8ca-c010fc4a3474 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Deleting attachment b84f2240-e030-4ca3-9c91-7266e10f50d7. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:33:51 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Acquiring lock "cinder-e6d6540d-eff1-40a9-86f1-675d10160ecb-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:33:51 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "cinder-e6d6540d-eff1-40a9-86f1-675d10160ecb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:33:51 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:33:51 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Acquiring lock "cinder-quobyte-e6d6540d-eff1-40a9-86f1-675d10160ecb" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:33:51 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "cinder-quobyte-e6d6540d-eff1-40a9-86f1-675d10160ecb" acquired by "delete_volume" :: waited 0.029s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:33:52 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[513a3095-c1ef-449b-91bf-8dab6bd99085]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:33:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-e6d6540d-eff1-40a9-86f1-675d10160ecb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:53 devstack quobyte-client[83739]: System call of process 94316 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:33:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-e6d6540d-eff1-40a9-86f1-675d10160ecb" returned: 0 in 1.251s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-e6d6540d-eff1-40a9-86f1-675d10160ecb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-e6d6540d-eff1-40a9-86f1-675d10160ecb" returned: 0 in 0.238s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:53 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "cinder-quobyte-e6d6540d-eff1-40a9-86f1-675d10160ecb" released by "delete_volume" :: held 1.800s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:33:54 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Created reservations ['91b38b42-f248-4ff9-a475-e8c68ef4d5bc', 'c58e2909-61d2-4d1a-8e50-791c683958b5', '50486ce8-f3cb-4dc2-9a98-323b23debfe2', '1c5147a0-d86d-469e-a6ee-d36b9e129923'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:33:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:33:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:33:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:33:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:33:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:33:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:33:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.154s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:33:54 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:33:54 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Deleted volume successfully. Sep 17 18:33:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-61aba915-a8ca-474e-a02c-84edad8dbc12 tempest-TestServerVolumeAttachScenarioOldVersion-1111347326 None] Lock "cinder-e6d6540d-eff1-40a9-86f1-675d10160ecb-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:34:04 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:34:04 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:34:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Flow 'volume_create_manager' (c7ebe55f-39f1-45b4-8ff5-5d96351cea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22835f6-6c8f-4c8a-b646-94e23e092359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22835f6-6c8f-4c8a-b646-94e23e092359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480756260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b93ffde-754a-453f-9400-a90cbde3311b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f8713ef6a644f2bf26e858a8c57d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:34:12Z,use_quota=True,user_id='9198d310a29441c1ac9dced69544147b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441c55d7-962f-48bc-802a-6f0bf3e2d5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441c55d7-962f-48bc-802a-6f0bf3e2d5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594260c6-d6ea-4ec0-98af-4f19bd8e06e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594260c6-d6ea-4ec0-98af-4f19bd8e06e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b93ffde-754a-453f-9400-a90cbde3311b', 'volume_name': 'volume-8b93ffde-754a-453f-9400-a90cbde3311b', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac031dfe-46dd-44f9-b49b-210743d6730e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac031dfe-46dd-44f9-b49b-210743d6730e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb84ae0-53de-4d72-a817-d6345940d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:34:12 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Volume 8b93ffde-754a-453f-9400-a90cbde3311b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b93ffde-754a-453f-9400-a90cbde3311b', 'volume_size': 1} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480756260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b93ffde-754a-453f-9400-a90cbde3311b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f8713ef6a644f2bf26e858a8c57d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:34:12Z,use_quota=True,user_id='9198d310a29441c1ac9dced69544147b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Creating volume 8b93ffde-754a-453f-9400-a90cbde3311b {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:34:12 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:34:12 devstack quobyte-client[83739]: System call of process 94413 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:34:12 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=78, name=volume-8b93ffde-754a-453f-9400-a90cbde3311b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b 1073741824" returned: 0 in 0.409s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b" returned: 0 in 0.194s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] <== create_volume: return (689ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:34:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:34:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb84ae0-53de-4d72-a817-d6345940d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b93ffde-754a-453f-9400-a90cbde3311b', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:34:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31a9e64-8633-41b3-b65f-8ad9f5707a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:34:13 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Volume volume-8b93ffde-754a-453f-9400-a90cbde3311b (8b93ffde-754a-453f-9400-a90cbde3311b): created successfully Sep 17 18:34:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31a9e64-8633-41b3-b65f-8ad9f5707a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:34:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Flow 'volume_create_manager' (c7ebe55f-39f1-45b4-8ff5-5d96351cea28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:34:13 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-8aad88da-ea17-47f8-b782-ee8004f5eac8 tempest-VolumesActionsTest-210336405 None] Created volume successfully. Sep 17 18:34:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:34:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:34:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:34:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:34:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:34:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:34:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:34:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.206s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:34:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:34:22 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:34:23 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:34:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:34:43 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:34:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Flow 'volume_create_manager' (df3d2207-e533-48f3-a356-f2f0a1168a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:34:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6000c5de-516b-4f21-a5a6-b9308a4eb491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:34:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6000c5de-516b-4f21-a5a6-b9308a4eb491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49c6474-efe2-4df9-a98c-86151d65caee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e98c454b934dcb8d14d6300e0a551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:34:43Z,use_quota=True,user_id='49b431516f354536ba31b28e928c6018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:34:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f4bc68-866a-4101-8719-771dbf305008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:34:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f4bc68-866a-4101-8719-771dbf305008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:34:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2b8f11-ff72-4920-89b6-f1a737cfa9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:34:43 devstack cinder-volume[83736]: DEBUG cinder.image.glance [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Creating Keystone auth plugin from conf {{(pid=83736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 17 18:34:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2b8f11-ff72-4920-89b6-f1a737cfa9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c49c6474-efe2-4df9-a98c-86151d65caee', 'volume_name': 'volume-c49c6474-efe2-4df9-a98c-86151d65caee', 'volume_size': 1, 'image_id': 'c74620e2-e87d-472f-9000-8de213a41c4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c74620e2-e87d-472f-9000-8de213a41c4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be547d169974bfe91fc0c2a455e03e36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49e98c454b934dcb8d14d6300e0a551b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d73fcac89e2e55ab3cc1118b82c1d2d53e125d97f229a714efd69c62b6bd74673479944b758fa4c3279462b00c7b74a9ab4def536cb6ae6dfb3c259d4e50859', 'id': 'c74620e2-e87d-472f-9000-8de213a41c4c', 'created_at': datetime.datetime(2025, 9, 17, 16, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 34, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c74620e2-e87d-472f-9000-8de213a41c4c/file', 'properties': {}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:34:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66937cde-24c7-4892-940f-fac7efb5ec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:34:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66937cde-24c7-4892-940f-fac7efb5ec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:34:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811f8937-428e-4923-8e57-ca32d6399b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:34:44 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Volume c49c6474-efe2-4df9-a98c-86151d65caee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c49c6474-efe2-4df9-a98c-86151d65caee', 'volume_size': 1, 'image_id': 'c74620e2-e87d-472f-9000-8de213a41c4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c74620e2-e87d-472f-9000-8de213a41c4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be547d169974bfe91fc0c2a455e03e36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49e98c454b934dcb8d14d6300e0a551b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d73fcac89e2e55ab3cc1118b82c1d2d53e125d97f229a714efd69c62b6bd74673479944b758fa4c3279462b00c7b74a9ab4def536cb6ae6dfb3c259d4e50859', 'id': 'c74620e2-e87d-472f-9000-8de213a41c4c', 'created_at': datetime.datetime(2025, 9, 17, 16, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 34, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c74620e2-e87d-472f-9000-8de213a41c4c/file', 'properties': {}}, 'image_service': } Sep 17 18:34:44 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Cloning c49c6474-efe2-4df9-a98c-86151d65caee from image c74620e2-e87d-472f-9000-8de213a41c4c at location (None, [{'url': 'file:///opt/stack/data/glance/images/c74620e2-e87d-472f-9000-8de213a41c4c', 'metadata': {}}]). {{(pid=83736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 17 18:34:44 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 18:34:44 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Image download 0.00 MB at 0.00 MB/s Sep 17 18:34:44 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[30489931-f05c-4647-a3f0-fa6456965b70]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:34:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:34:46 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD Sep 17 18:34:46 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:34:48 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Sep 17 18:34:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD" returned: 0 in 4.004s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:34:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:34:49 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD Sep 17 18:34:49 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:34:51 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5dbe64ca-3c3b-4983-b9d3-4187d15c9ea8 tempest-VolumesActionsTest-210336405 None] Acquiring lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b" by "attach_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:34:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5dbe64ca-3c3b-4983-b9d3-4187d15c9ea8 tempest-VolumesActionsTest-210336405 None] Lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b" acquired by "attach_volume" :: waited 1.089s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:34:53 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-5dbe64ca-3c3b-4983-b9d3-4187d15c9ea8 tempest-VolumesActionsTest-210336405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:34:53 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-5dbe64ca-3c3b-4983-b9d3-4187d15c9ea8 tempest-VolumesActionsTest-210336405 None] Attaching volume 8b93ffde-754a-453f-9400-a90cbde3311b to instance defbd247-0552-4a70-b56e-792d0dfc0c6b at mountpoint /dev/vdb on host None. Sep 17 18:34:53 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-5dbe64ca-3c3b-4983-b9d3-4187d15c9ea8 tempest-VolumesActionsTest-210336405 None] Attach volume completed successfully. Sep 17 18:34:53 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5dbe64ca-3c3b-4983-b9d3-4187d15c9ea8 tempest-VolumesActionsTest-210336405 None] Lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b" released by "attach_volume" :: held 1.238s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:34:53 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Sep 17 18:34:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD" returned: 1 in 5.081s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:34:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:34:54 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Temporary image c74620e2-e87d-472f-9000-8de213a41c4c is fetched for user 49b431516f354536ba31b28e928c6018. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 18:34:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-0dbd1a92-3dc3-4f8a-a460-7c83d9531bac tempest-VolumesActionsTest-210336405 None] Acquiring lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b-detach_volume" by "detach_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:34:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-0dbd1a92-3dc3-4f8a-a460-7c83d9531bac tempest-VolumesActionsTest-210336405 None] Lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b-detach_volume" acquired by "detach_volume" :: waited 0.071s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:34:54 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-0dbd1a92-3dc3-4f8a-a460-7c83d9531bac tempest-VolumesActionsTest-210336405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:34:54 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-0dbd1a92-3dc3-4f8a-a460-7c83d9531bac tempest-VolumesActionsTest-210336405 None] Detaching volume 8b93ffde-754a-453f-9400-a90cbde3311b from instance defbd247-0552-4a70-b56e-792d0dfc0c6b. Sep 17 18:34:54 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-0dbd1a92-3dc3-4f8a-a460-7c83d9531bac tempest-VolumesActionsTest-210336405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:34:54 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce88658e-07f0-4c81-a397-4e1e5f6966e2]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:34:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:34:55 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-0dbd1a92-3dc3-4f8a-a460-7c83d9531bac tempest-VolumesActionsTest-210336405 None] Detach volume completed successfully. Sep 17 18:34:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-0dbd1a92-3dc3-4f8a-a460-7c83d9531bac tempest-VolumesActionsTest-210336405 None] Lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b-detach_volume" released by "detach_volume" :: held 1.416s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:34:55 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD Sep 17 18:34:55 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:35:00 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Sep 17 18:35:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD" returned: 0 in 6.075s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:01 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD Sep 17 18:35:01 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:35:04 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD" returned: 1 in 4.030s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49c6474-efe2-4df9-a98c-86151d65caee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e98c454b934dcb8d14d6300e0a551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:34:43Z,use_quota=True,user_id='49b431516f354536ba31b28e928c6018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Creating volume c49c6474-efe2-4df9-a98c-86151d65caee {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.107s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:35:04 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:35:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:04 devstack quobyte-client[83739]: System call of process 94735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:35:05 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=79, name=volume-c49c6474-efe2-4df9-a98c-86151d65caee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:35:05 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9,cinder:INSERT=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:35:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee 1073741824" returned: 0 in 0.914s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee" returned: 0 in 0.130s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] <== create_volume: return (1210ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:35:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:35:06 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Attempting download of c74620e2-e87d-472f-9000-8de213a41c4c ((None, [{'url': 'file:///opt/stack/data/glance/images/c74620e2-e87d-472f-9000-8de213a41c4c', 'metadata': {}}])) to volume c49c6474-efe2-4df9-a98c-86151d65caee. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 18:35:06 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6804996d-b96c-4d6e-afc8-4794cd0b1a32]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:35:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c74620e2-e87d-472f-9000-8de213a41c4c_xrmcj670 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c74620e2-e87d-472f-9000-8de213a41c4c_xrmcj670" returned: 0 in 0.448s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c74620e2-e87d-472f-9000-8de213a41c4c_xrmcj670 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c74620e2-e87d-472f-9000-8de213a41c4c_xrmcj670" returned: 1 in 0.397s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c74620e2-e87d-472f-9000-8de213a41c4c_xrmcj670' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:35:07 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bd9d5b-5b69-487a-adfc-2eccf4f28b89]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:35:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD" returned: 1 in 0.610s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:35:08 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] c74620e2-e87d-472f-9000-8de213a41c4c was raw, converting to raw {{(pid=83736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 18:35:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:08 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=79, name=volume-c49c6474-efe2-4df9-a98c-86151d65caee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:35:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee" returned: 0 in 0.220s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:08 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c74620e2-e87d-472f-9000-8de213a41c4c_ylqz4edudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:35:08 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 18:35:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:08 devstack quobyte-client[83739]: System call of process 94770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:35:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee 1G" returned: 0 in 0.212s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:09 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad65b02-5e9c-4811-8ba2-89909d43bc1f]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:35:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee" returned: 0 in 0.521s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee" returned: 1 in 0.413s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:35:10 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Downloaded image c74620e2-e87d-472f-9000-8de213a41c4c ((None, [{'url': 'file:///opt/stack/data/glance/images/c74620e2-e87d-472f-9000-8de213a41c4c', 'metadata': {}}])) to volume c49c6474-efe2-4df9-a98c-86151d65caee successfully. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 18:35:10 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Temporary image c74620e2-e87d-472f-9000-8de213a41c4c for user 49b431516f354536ba31b28e928c6018 is deleted. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 18:35:10 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Marking volume c49c6474-efe2-4df9-a98c-86151d65caee as bootable. {{(pid=83736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 18:35:10 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Copying metadata from image c74620e2-e87d-472f-9000-8de213a41c4c to c49c6474-efe2-4df9-a98c-86151d65caee. {{(pid=83736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 18:35:10 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Creating volume glance metadata for volume c49c6474-efe2-4df9-a98c-86151d65caee backed by image c74620e2-e87d-472f-9000-8de213a41c4c with: {'image_id': 'c74620e2-e87d-472f-9000-8de213a41c4c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'be547d169974bfe91fc0c2a455e03e36', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 18:35:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811f8937-428e-4923-8e57-ca32d6399b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49c6474-efe2-4df9-a98c-86151d65caee', 'volume_size': 1, 'image_id': 'c74620e2-e87d-472f-9000-8de213a41c4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c74620e2-e87d-472f-9000-8de213a41c4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be547d169974bfe91fc0c2a455e03e36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49e98c454b934dcb8d14d6300e0a551b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d73fcac89e2e55ab3cc1118b82c1d2d53e125d97f229a714efd69c62b6bd74673479944b758fa4c3279462b00c7b74a9ab4def536cb6ae6dfb3c259d4e50859', 'id': 'c74620e2-e87d-472f-9000-8de213a41c4c', 'created_at': datetime.datetime(2025, 9, 17, 16, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 34, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c74620e2-e87d-472f-9000-8de213a41c4c/file', 'properties': {}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49f544a-13cb-43f2-be6e-d03b63cd4ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:10 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Volume volume-c49c6474-efe2-4df9-a98c-86151d65caee (c49c6474-efe2-4df9-a98c-86151d65caee): created successfully Sep 17 18:35:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49f544a-13cb-43f2-be6e-d03b63cd4ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Flow 'volume_create_manager' (df3d2207-e533-48f3-a356-f2f0a1168a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:35:10 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-dc6384b1-3c85-4ba1-a3c6-6816fef8387b tempest-VolumeImageDependencyTests-1116970036 None] Created volume successfully. Sep 17 18:35:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Acquiring lock "cinder-c49c6474-efe2-4df9-a98c-86151d65caee-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:35:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Lock "cinder-c49c6474-efe2-4df9-a98c-86151d65caee-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:35:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:35:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Acquiring lock "cinder-quobyte-c49c6474-efe2-4df9-a98c-86151d65caee" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:35:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Lock "cinder-quobyte-c49c6474-efe2-4df9-a98c-86151d65caee" acquired by "delete_volume" :: waited 0.036s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:35:12 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[759bd77c-55e9-4a3c-abf0-d0cff5ab87f6]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:35:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee" returned: 0 in 0.479s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee" returned: 1 in 0.478s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:35:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c49c6474-efe2-4df9-a98c-86151d65caee" returned: 0 in 0.092s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Lock "cinder-quobyte-c49c6474-efe2-4df9-a98c-86151d65caee" released by "delete_volume" :: held 1.340s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:35:13 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Created reservations ['b6f81928-b7fc-4127-ae73-1ae546f5cae0', '342f1afa-9e1f-4a7d-8242-f0076335af52', '9af955a7-82ea-4914-9b1b-beb8af57db9f', '06b61834-2a0b-4f2f-a85e-c993f4e929ec'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:35:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:35:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:35:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:35:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:35:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:35:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.189s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:14 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:35:14 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Deleted volume successfully. Sep 17 18:35:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-72e60d2d-7960-44ad-9ef2-0e424cc90f87 tempest-VolumeImageDependencyTests-1116970036 None] Lock "cinder-c49c6474-efe2-4df9-a98c-86151d65caee-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:35:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:35:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:35:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:35:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:35:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:35:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:35:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.221s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:35:28 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=13,cinder:SELECT=14,cinder:INSERT=11 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:35:28 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:DELETE=2,cinder:INSERT=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:35:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4cb202b4-7b49-43f0-989a-717633ead681 tempest-VolumesActionsTest-210336405 None] Acquiring lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b" by "attach_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:35:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4cb202b4-7b49-43f0-989a-717633ead681 tempest-VolumesActionsTest-210336405 None] Lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b" acquired by "attach_volume" :: waited 0.056s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:35:38 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4cb202b4-7b49-43f0-989a-717633ead681 tempest-VolumesActionsTest-210336405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:35:38 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4cb202b4-7b49-43f0-989a-717633ead681 tempest-VolumesActionsTest-210336405 None] Attaching volume 8b93ffde-754a-453f-9400-a90cbde3311b to instance b5abadbf-0203-4d8f-ab4e-92438c690d01 at mountpoint /dev/vdb on host None. Sep 17 18:35:38 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4cb202b4-7b49-43f0-989a-717633ead681 tempest-VolumesActionsTest-210336405 None] Attach volume completed successfully. Sep 17 18:35:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4cb202b4-7b49-43f0-989a-717633ead681 tempest-VolumesActionsTest-210336405 None] Lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b" released by "attach_volume" :: held 0.549s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:35:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a9f5e069-2086-4f95-a5d6-e9f886791099 tempest-VolumesActionsTest-210336405 None] Acquiring lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b-detach_volume" by "detach_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:35:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a9f5e069-2086-4f95-a5d6-e9f886791099 tempest-VolumesActionsTest-210336405 None] Lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:35:39 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a9f5e069-2086-4f95-a5d6-e9f886791099 tempest-VolumesActionsTest-210336405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:35:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a9f5e069-2086-4f95-a5d6-e9f886791099 tempest-VolumesActionsTest-210336405 None] Detaching volume 8b93ffde-754a-453f-9400-a90cbde3311b from instance b5abadbf-0203-4d8f-ab4e-92438c690d01. Sep 17 18:35:39 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a9f5e069-2086-4f95-a5d6-e9f886791099 tempest-VolumesActionsTest-210336405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:35:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a9f5e069-2086-4f95-a5d6-e9f886791099 tempest-VolumesActionsTest-210336405 None] Detach volume completed successfully. Sep 17 18:35:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a9f5e069-2086-4f95-a5d6-e9f886791099 tempest-VolumesActionsTest-210336405 None] Lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b-detach_volume" released by "detach_volume" :: held 0.193s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:35:42 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:35:42 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Flow 'volume_create_manager' (c65785ca-708f-4792-9ad0-a0b70702b46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f01675-f8ca-43fc-b730-5ceb6b29a519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f01675-f8ca-43fc-b730-5ceb6b29a519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-323020931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42ac199-c254-44e0-81c8-900e10c25baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3d457c985f4a78a3dd2f3ed407bc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:35:42Z,use_quota=True,user_id='1cae01c404bf4aee8c8ae3263595cb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124089a2-465a-42f4-9c2f-25fafd1693a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124089a2-465a-42f4-9c2f-25fafd1693a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b3361f-1795-495f-9b10-3ba4f7edc6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b3361f-1795-495f-9b10-3ba4f7edc6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c42ac199-c254-44e0-81c8-900e10c25baf', 'volume_name': 'volume-c42ac199-c254-44e0-81c8-900e10c25baf', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471b52aa-95c9-484a-85ae-7440cd05db38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471b52aa-95c9-484a-85ae-7440cd05db38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b3e298-8537-4d6e-8e35-5b8ae52fb9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:43 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Volume c42ac199-c254-44e0-81c8-900e10c25baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c42ac199-c254-44e0-81c8-900e10c25baf', 'volume_size': 1} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-323020931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42ac199-c254-44e0-81c8-900e10c25baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3d457c985f4a78a3dd2f3ed407bc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:35:42Z,use_quota=True,user_id='1cae01c404bf4aee8c8ae3263595cb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Creating volume c42ac199-c254-44e0-81c8-900e10c25baf {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:35:43 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:35:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c42ac199-c254-44e0-81c8-900e10c25baf 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:43 devstack quobyte-client[83739]: System call of process 94947 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:35:43 devstack quobyte-client[83739]: System call of process 94947 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:35:43 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=80, name=volume-c42ac199-c254-44e0-81c8-900e10c25baf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:35:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c42ac199-c254-44e0-81c8-900e10c25baf 1073741824" returned: 0 in 0.775s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c42ac199-c254-44e0-81c8-900e10c25baf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c42ac199-c254-44e0-81c8-900e10c25baf" returned: 0 in 0.171s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] <== create_volume: return (1111ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:35:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:35:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b3e298-8537-4d6e-8e35-5b8ae52fb9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c42ac199-c254-44e0-81c8-900e10c25baf', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8fe4ce-f5b7-488a-80b1-07627a7f36bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:45 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Volume volume-c42ac199-c254-44e0-81c8-900e10c25baf (c42ac199-c254-44e0-81c8-900e10c25baf): created successfully Sep 17 18:35:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8fe4ce-f5b7-488a-80b1-07627a7f36bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Flow 'volume_create_manager' (c65785ca-708f-4792-9ad0-a0b70702b46a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:35:45 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c59bc602-b592-4688-add9-38a08ec07272 tempest-AttachVolumeTestJSON-315441114 None] Created volume successfully. Sep 17 18:35:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-03e8265c-9417-4964-991b-36d746f0f9ea req-5f3e01ca-09bc-42ad-bd8e-e64b6a63b7ad tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:35:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-03e8265c-9417-4964-991b-36d746f0f9ea req-5f3e01ca-09bc-42ad-bd8e-e64b6a63b7ad tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:35:50 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb3371f-b49a-48e9-9d8f-e13494fbcef7]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:35:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-03e8265c-9417-4964-991b-36d746f0f9ea req-5f3e01ca-09bc-42ad-bd8e-e64b6a63b7ad tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c42ac199-c254-44e0-81c8-900e10c25baf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-03e8265c-9417-4964-991b-36d746f0f9ea req-5f3e01ca-09bc-42ad-bd8e-e64b6a63b7ad tempest-AttachVolumeTestJSON-315441114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c42ac199-c254-44e0-81c8-900e10c25baf" returned: 0 in 0.853s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-03e8265c-9417-4964-991b-36d746f0f9ea req-5f3e01ca-09bc-42ad-bd8e-e64b6a63b7ad tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.064s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:35:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-03e8265c-9417-4964-991b-36d746f0f9ea req-5f3e01ca-09bc-42ad-bd8e-e64b6a63b7ad tempest-AttachVolumeTestJSON-315441114 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-c42ac199-c254-44e0-81c8-900e10c25baf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '619e9c2b-440a-403b-bd66-c4d17ccdeed9', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:35:51 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-03e8265c-9417-4964-991b-36d746f0f9ea req-5f3e01ca-09bc-42ad-bd8e-e64b6a63b7ad tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:35:52 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-03e8265c-9417-4964-991b-36d746f0f9ea req-5f3e01ca-09bc-42ad-bd8e-e64b6a63b7ad tempest-AttachVolumeTestJSON-315441114 None] attachment_update completed successfully. Sep 17 18:35:54 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:35:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:35:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:35:54 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8b5c81-ba19-4c55-82eb-da5b8b0d1bfd]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:35:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b" returned: 0 in 1.261s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:56 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4bc685-d49e-462f-bfa9-b8f54ada65f5]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:35:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:56 devstack quobyte-client[83739]: System call of process 95364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:35:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b" returned: 0 in 0.574s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:35:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.0eedf9cc-52d1-4818-8695-c1e39a1748fdeilrix7y.img {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:35:57 devstack quobyte-client[83739]: System call of process 95367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:35:59 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Flow 'volume_create_manager' (74025d0f-d711-4add-b77f-2427344c8ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7ab297-bb58-45d6-a58b-de36a7cc256b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7ab297-bb58-45d6-a58b-de36a7cc256b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-973063344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8371b145-dcb6-4440-80e8-44febe4f4537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc55c98d0f1412693e674cc94a7a472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:35:58Z,use_quota=True,user_id='2335a90f923c48848bb0c209d5d857f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af801cba-f46e-4b0c-84fa-457c63f88cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af801cba-f46e-4b0c-84fa-457c63f88cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0649b78e-8fe2-4bad-be48-11229934e65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0649b78e-8fe2-4bad-be48-11229934e65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8371b145-dcb6-4440-80e8-44febe4f4537', 'volume_name': 'volume-8371b145-dcb6-4440-80e8-44febe4f4537', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092238c2-72b4-4a7f-8223-18563cbae974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092238c2-72b4-4a7f-8223-18563cbae974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5221ae57-f581-4890-a8ee-f86ecfbb0d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:35:59 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Volume 8371b145-dcb6-4440-80e8-44febe4f4537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8371b145-dcb6-4440-80e8-44febe4f4537', 'volume_size': 1} Sep 17 18:35:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:36:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.0eedf9cc-52d1-4818-8695-c1e39a1748fdeilrix7y.img" returned: 0 in 6.221s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:03 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb513138-84fe-4772-8c76-4ca15f52a280]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:36:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b" returned: 0 in 0.519s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:03 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.0eedf9cc-52d1-4818-8695-c1e39a1748fdeilrix7y.img {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:36:03 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Converted 1024.00 MB image at 164.50 MB/s Sep 17 18:36:03 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] 0eedf9cc-52d1-4818-8695-c1e39a1748fd was raw, no need to convert to raw {{(pid=83736) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 17 18:36:04 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Flow 'volume_create_manager' (a0b8132a-8549-4880-800b-fba80d6030fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b889195e-8b7c-44c4-8d42-37df4be2ccaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b889195e-8b7c-44c4-8d42-37df4be2ccaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-97878012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5308996f-943d-4133-b0fa-6b6cd8a96909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3d457c985f4a78a3dd2f3ed407bc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:36:04Z,use_quota=True,user_id='1cae01c404bf4aee8c8ae3263595cb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ca4337-f66e-4bad-b3a7-3a2ecc5ff8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ca4337-f66e-4bad-b3a7-3a2ecc5ff8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23901f2-da75-4b7f-81f2-a7a645d26b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23901f2-da75-4b7f-81f2-a7a645d26b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5308996f-943d-4133-b0fa-6b6cd8a96909', 'volume_name': 'volume-5308996f-943d-4133-b0fa-6b6cd8a96909', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df424e29-8870-49ee-aa6f-ee1a380f99aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df424e29-8870-49ee-aa6f-ee1a380f99aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e8c590-d3f6-4b24-a337-df905b5f4a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:36:04 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Volume 5308996f-943d-4133-b0fa-6b6cd8a96909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5308996f-943d-4133-b0fa-6b6cd8a96909', 'volume_size': 1} Sep 17 18:36:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:36:14 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:INSERT=1,cinder:SELECT=17,cinder:UPDATE=9 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:36:14 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=16,cinder:INSERT=1,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:36:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:36:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:36:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:36:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:36:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:36:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:36:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.224s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:36:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 46.181s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:36:40 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Uploaded volume to glance image-id: 0eedf9cc-52d1-4818-8695-c1e39a1748fd. {{(pid=83736) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 41.188s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-973063344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8371b145-dcb6-4440-80e8-44febe4f4537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc55c98d0f1412693e674cc94a7a472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:35:58Z,use_quota=True,user_id='2335a90f923c48848bb0c209d5d857f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Creating volume 8371b145-dcb6-4440-80e8-44febe4f4537 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:36:41 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:41 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=81, name=volume-8371b145-dcb6-4440-80e8-44febe4f4537, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 1073741824" returned: 0 in 0.443s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537" returned: 0 in 0.093s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] <== create_volume: return (608ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.629s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 37.245s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-97878012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5308996f-943d-4133-b0fa-6b6cd8a96909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3d457c985f4a78a3dd2f3ed407bc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:36:04Z,use_quota=True,user_id='1cae01c404bf4aee8c8ae3263595cb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Creating volume 5308996f-943d-4133-b0fa-6b6cd8a96909 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:36:41 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:36:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5308996f-943d-4133-b0fa-6b6cd8a96909 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:42 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=82, name=volume-5308996f-943d-4133-b0fa-6b6cd8a96909, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:36:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5308996f-943d-4133-b0fa-6b6cd8a96909 1073741824" returned: 0 in 0.352s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5308996f-943d-4133-b0fa-6b6cd8a96909 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5308996f-943d-4133-b0fa-6b6cd8a96909" returned: 0 in 0.107s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] <== create_volume: return (556ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:36:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.588s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:36:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a73ceaf5-3878-4c3a-a4c4-1a2702086c74 tempest-VolumesActionsTest-210336405 None] Copy volume to image completed successfully. Sep 17 18:36:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e8c590-d3f6-4b24-a337-df905b5f4a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5308996f-943d-4133-b0fa-6b6cd8a96909', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:36:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551ceee0-2fab-4f4c-a56a-4762b14710df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:36:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5221ae57-f581-4890-a8ee-f86ecfbb0d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8371b145-dcb6-4440-80e8-44febe4f4537', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:36:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27fb0c37-afc0-44b6-8b17-3b234c45009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:36:44 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Volume volume-8371b145-dcb6-4440-80e8-44febe4f4537 (8371b145-dcb6-4440-80e8-44febe4f4537): created successfully Sep 17 18:36:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27fb0c37-afc0-44b6-8b17-3b234c45009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:36:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Flow 'volume_create_manager' (74025d0f-d711-4add-b77f-2427344c8ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:36:44 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Volume volume-5308996f-943d-4133-b0fa-6b6cd8a96909 (5308996f-943d-4133-b0fa-6b6cd8a96909): created successfully Sep 17 18:36:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551ceee0-2fab-4f4c-a56a-4762b14710df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:36:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Flow 'volume_create_manager' (a0b8132a-8549-4880-800b-fba80d6030fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:36:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-677e6aad-c3a1-4068-a426-4f86736b1841 tempest-AttachVolumeTestJSON-315441114 None] Created volume successfully. Sep 17 18:36:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-30bc02dc-9b26-4ea7-a533-b881e07c6fda tempest-SnapshotDependencyTests-759710262 None] Created volume successfully. Sep 17 18:36:45 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:36:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:36:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:36:45 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8a6c37-ae3c-4313-9f6f-9fece44a141e]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:36:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:46 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:36:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:36:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b" returned: 0 in 0.549s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:46 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3611682-9a89-4888-8e9a-501df605534c]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:36:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b" returned: 0 in 0.392s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.94c5074a-c5ff-45d2-bb82-7d1f7a5103906zbrc_jw.img {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-e720308e-6836-46fc-ba9f-b8160b2e7790 req-0956dabf-1f71-4e52-91b0-a305d9189245 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:36:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.94c5074a-c5ff-45d2-bb82-7d1f7a5103906zbrc_jw.img" returned: 0 in 5.662s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:52 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2fee68-0f33-4ad8-ad32-967e08fae9ad]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:36:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b" returned: 0 in 0.529s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:52 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.94c5074a-c5ff-45d2-bb82-7d1f7a5103906zbrc_jw.img {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:36:52 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Converted 1024.00 MB image at 180.69 MB/s Sep 17 18:36:53 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] 94c5074a-c5ff-45d2-bb82-7d1f7a510390 was raw, converting to qcow2 {{(pid=83736) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 17 18:36:53 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d23bb45-4c4e-46d1-bb94-34bdabfe2d42]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:36:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.94c5074a-c5ff-45d2-bb82-7d1f7a5103906zbrc_jw.img {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.94c5074a-c5ff-45d2-bb82-7d1f7a5103906zbrc_jw.img" returned: 0 in 0.502s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.94c5074a-c5ff-45d2-bb82-7d1f7a5103906zbrc_jw.img {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.94c5074a-c5ff-45d2-bb82-7d1f7a5103906zbrc_jw.img" returned: 1 in 0.514s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.94c5074a-c5ff-45d2-bb82-7d1f7a5103906zbrc_jw.img' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:36:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.94c5074a-c5ff-45d2-bb82-7d1f7a5103906zbrc_jw.img /opt/stack/data/cinder/conversion/vol_upload_kmswxz4h {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.94c5074a-c5ff-45d2-bb82-7d1f7a5103906zbrc_jw.img /opt/stack/data/cinder/conversion/vol_upload_kmswxz4h" returned: 0 in 0.224s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:54 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Image conversion details: src /opt/stack/data/cinder/conversion/8b93ffde-754a-453f-9400-a90cbde3311b.temp_image.94c5074a-c5ff-45d2-bb82-7d1f7a5103906zbrc_jw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kmswxz4h {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:36:54 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 17 18:36:54 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68d598d-c337-4a0e-8624-f7932f4e539a]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:36:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kmswxz4h {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kmswxz4h" returned: 0 in 0.456s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.274s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:36:56 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Uploaded volume to glance image-id: 94c5074a-c5ff-45d2-bb82-7d1f7a510390. {{(pid=83736) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 17 18:36:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.831s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:36:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Creating offline snapshot f1768ff7-3620-4d79-9370-5c07220bae7e of volume 8371b145-dcb6-4440-80e8-44febe4f4537 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:36:56 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-9c6cd07f-18c9-44af-bf59-50ace3a08d7c tempest-VolumesActionsTest-210336405 None] Copy volume to image completed successfully. Sep 17 18:36:56 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed1dab2-5ad7-4962-a403-9cfbb3870cc8]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:36:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537" returned: 0 in 0.456s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:57 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=83, name=volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:36:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e 1G" returned: 0 in 0.266s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8371b145-dcb6-4440-80e8-44febe4f4537 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:57 devstack quobyte-client[83739]: System call of process 95532 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:36:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] CMD "qemu-img rebase -u -b volume-8371b145-dcb6-4440-80e8-44febe4f4537 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e" returned: 0 in 0.175s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:36:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e" returned: 0 in 0.125s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:36:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:58 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Acquiring lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:36:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e" returned: 0 in 0.380s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:58 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b-delete_volume" acquired by "delete_volume" :: waited 0.227s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:36:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.info" returned: 0 in 0.320s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:36:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.info" returned: 0 in 0.293s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:36:59 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:36:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Acquiring lock "cinder-quobyte-8b93ffde-754a-453f-9400-a90cbde3311b" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:36:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:36:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-e720308e-6836-46fc-ba9f-b8160b2e7790 req-0956dabf-1f71-4e52-91b0-a305d9189245 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.741s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:36:59 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[373aef67-9b63-4686-8427-a93f6df19513]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:36:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-e720308e-6836-46fc-ba9f-b8160b2e7790 req-0956dabf-1f71-4e52-91b0-a305d9189245 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5308996f-943d-4133-b0fa-6b6cd8a96909 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Lock "cinder-quobyte-8b93ffde-754a-453f-9400-a90cbde3311b" acquired by "delete_volume" :: waited 0.261s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:36:59 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1971f-b08a-4a27-96a6-6889cc6eb9f0]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:36:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:36:59 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-30a7e3c6-e12b-4a6d-97fb-43e50862b788 tempest-SnapshotDependencyTests-759710262 None] Create snapshot completed successfully Sep 17 18:37:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-e720308e-6836-46fc-ba9f-b8160b2e7790 req-0956dabf-1f71-4e52-91b0-a305d9189245 tempest-AttachVolumeTestJSON-315441114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5308996f-943d-4133-b0fa-6b6cd8a96909" returned: 0 in 0.696s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-e720308e-6836-46fc-ba9f-b8160b2e7790 req-0956dabf-1f71-4e52-91b0-a305d9189245 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.766s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-e720308e-6836-46fc-ba9f-b8160b2e7790 req-0956dabf-1f71-4e52-91b0-a305d9189245 tempest-AttachVolumeTestJSON-315441114 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-5308996f-943d-4133-b0fa-6b6cd8a96909', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3f9a6f1-2930-4487-93ed-7b63c474e570', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:37:00 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-e720308e-6836-46fc-ba9f-b8160b2e7790 req-0956dabf-1f71-4e52-91b0-a305d9189245 tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b" returned: 0 in 0.616s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8b93ffde-754a-453f-9400-a90cbde3311b" returned: 0 in 0.372s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:00 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Lock "cinder-quobyte-8b93ffde-754a-453f-9400-a90cbde3311b" released by "delete_volume" :: held 1.297s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:00 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-e720308e-6836-46fc-ba9f-b8160b2e7790 req-0956dabf-1f71-4e52-91b0-a305d9189245 tempest-AttachVolumeTestJSON-315441114 None] attachment_update completed successfully. Sep 17 18:37:00 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Created reservations ['37f1ef30-cd67-48b4-8963-d723a8e81b1e', '90ec9098-7d8f-4798-9c27-43fcf3eea437', 'c6d55f73-40fe-4dcf-9180-20097db7ab27', '1a66dba6-5554-4a08-a5f0-38bb721ae50a'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.125s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:37:01 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Deleted volume successfully. Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c34d086b-5a66-4d50-aba9-f3f23912f3b8 tempest-VolumesActionsTest-210336405 None] Lock "cinder-8b93ffde-754a-453f-9400-a90cbde3311b-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:01 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Flow 'volume_create_manager' (4f3b04ce-79eb-498a-8b39-7182f2470ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbacb24-c0f5-4b7a-8eec-79695dd4f9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbacb24-c0f5-4b7a-8eec-79695dd4f9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8eaa7e4-3e17-4630-9234-b9641c0aaab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc55c98d0f1412693e674cc94a7a472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f1768ff7-3620-4d79-9370-5c07220bae7e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:37:01Z,use_quota=True,user_id='2335a90f923c48848bb0c209d5d857f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eaf4119-6043-4ffa-accb-ced31780a681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eaf4119-6043-4ffa-accb-ced31780a681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd533b9a-31c9-46b1-909b-e1d660c86b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd533b9a-31c9-46b1-909b-e1d660c86b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8eaa7e4-3e17-4630-9234-b9641c0aaab1', 'volume_name': 'volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1', 'volume_size': 1, 'snapshot_id': 'f1768ff7-3620-4d79-9370-5c07220bae7e'}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c41e486-8e4d-4038-923e-41161db65746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c41e486-8e4d-4038-923e-41161db65746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2a306d-8651-4d6f-81ef-a4be5da1b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:01 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Volume b8eaa7e4-3e17-4630-9234-b9641c0aaab1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1', 'volume_size': 1, 'snapshot_id': 'f1768ff7-3620-4d79-9370-5c07220bae7e'} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "cinder-quobyte-f1768ff7-3620-4d79-9370-5c07220bae7e-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" by "_create_volume_from_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-f1768ff7-3620-4d79-9370-5c07220bae7e-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Creating volume b8eaa7e4-3e17-4630-9234-b9641c0aaab1 from snapshot f1768ff7-3620-4d79-9370-5c07220bae7e {{(pid=83736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "cinder-quobyte-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" by "_copy_volume_from_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] snapshot: f1768ff7-3620-4d79-9370-5c07220bae7e, volume: b8eaa7e4-3e17-4630-9234-b9641c0aaab1, {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[de412a7c-1350-4631-921d-874a4fc27025]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:02 devstack quobyte-client[83739]: System call of process 95550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e" returned: 0 in 0.651s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8371b145-dcb6-4440-80e8-44febe4f4537(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Creating direct copy from snapshot {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d12ec3-bdaf-4a3a-b4ca-cb8e0e1b4021]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:37:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537" returned: 0 in 0.675s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:03 devstack cinder-volume[83736]: DEBUG cinder.utils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1 not found in is_blk_device check {{(pid=83736) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 17 18:37:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:03 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=85, name=volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:37:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" returned: 0 in 6.762s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:10 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ba6bf5-0a15-4404-85e3-0d8f5cd4f6cd]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:37:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537" returned: 0 in 0.764s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:11 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537, size 1024.00 MB, duration 6.79 sec, destination /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1 {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:37:11 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Converted 1024.00 MB image at 150.88 MB/s Sep 17 18:37:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:37:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" returned: 0 in 0.176s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:11 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" released by "_copy_volume_from_snapshot" :: held 9.628s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:11 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-f1768ff7-3620-4d79-9370-5c07220bae7e-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" released by "_create_volume_from_snapshot" :: held 9.681s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.708s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:12 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=19,cinder:DELETE=1,cinder:SELECT=18,cinder:INSERT=3 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:37:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2a306d-8651-4d6f-81ef-a4be5da1b62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1', 'volume_size': 1, 'snapshot_id': 'f1768ff7-3620-4d79-9370-5c07220bae7e'}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbc5111-caca-4832-8431-69f3457a34ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:12 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Volume volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1 (b8eaa7e4-3e17-4630-9234-b9641c0aaab1): created successfully Sep 17 18:37:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbc5111-caca-4832-8431-69f3457a34ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Flow 'volume_create_manager' (4f3b04ce-79eb-498a-8b39-7182f2470ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:37:12 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7cadb1a1-1389-455a-81e3-e4e08ca248ec tempest-SnapshotDependencyTests-759710262 None] Created volume successfully. Sep 17 18:37:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "cinder-f1768ff7-3620-4d79-9370-5c07220bae7e-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-f1768ff7-3620-4d79-9370-5c07220bae7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:13 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "cinder-quobyte-8371b145-dcb6-4440-80e8-44febe4f4537" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-8371b145-dcb6-4440-80e8-44febe4f4537" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "cinder-quobyte-f1768ff7-3620-4d79-9370-5c07220bae7e" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-f1768ff7-3620-4d79-9370-5c07220bae7e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Deleting offline snapshot f1768ff7-3620-4d79-9370-5c07220bae7e of volume 8371b145-dcb6-4440-80e8-44febe4f4537 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:37:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] snapshot_file for this snap is: volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:37:13 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f4e2c8-8b9b-4c06-a1f2-b85f139ccc4a]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:37:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e" returned: 0 in 0.648s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8371b145-dcb6-4440-80e8-44febe4f4537(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:37:14 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[95937a09-985c-459a-93f6-107d12dd2d86]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:37:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537" returned: 0 in 0.558s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e" returned: 0 in 0.228s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537.f1768ff7-3620-4d79-9370-5c07220bae7e" returned: 0 in 0.128s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-f1768ff7-3620-4d79-9370-5c07220bae7e" released by "_delete_snapshot" :: held 1.870s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-8371b145-dcb6-4440-80e8-44febe4f4537" released by "delete_snapshot" :: held 1.896s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:15 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Created reservations ['5852b38b-39d2-40a2-8c72-f9bb57c6343c', '760b3bee-8ee3-4af3-98d9-beb77e7244df', 'ab7d4449-f44b-4f0f-983c-460627600137', 'c9b9ad04-df4b-4a67-9c4c-28f291949abe'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:37:16 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Delete snapshot completed successfully. Sep 17 18:37:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-96d6a980-2d37-4505-8728-ec366074287e tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-f1768ff7-3620-4d79-9370-5c07220bae7e-delete_snapshot" released by "delete_snapshot" :: held 2.421s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "cinder-8371b145-dcb6-4440-80e8-44febe4f4537-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:37:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-8371b145-dcb6-4440-80e8-44febe4f4537-delete_volume" acquired by "delete_volume" :: waited 0.186s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.381s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:37:17 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "cinder-quobyte-8371b145-dcb6-4440-80e8-44febe4f4537" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-8371b145-dcb6-4440-80e8-44febe4f4537" acquired by "delete_volume" :: waited 0.026s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:17 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b836f9-bd13-4f1e-8e8f-1e6e577657ff]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:37:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537" returned: 0 in 0.505s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8371b145-dcb6-4440-80e8-44febe4f4537" returned: 0 in 0.103s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-8371b145-dcb6-4440-80e8-44febe4f4537" released by "delete_volume" :: held 0.792s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Created reservations ['e643b716-11c8-4a9b-8c06-e44d056fb85c', 'ff209644-8dfb-4e35-958d-27918cc544b2', '60b42322-7c79-4cb7-b8f6-cb34d9bdcde2', 'fee9fbfc-9504-4887-bd93-e78d45cff93f'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.105s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:18 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:37:19 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Deleted volume successfully. Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "cinder-b8eaa7e4-3e17-4630-9234-b9641c0aaab1-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-b8eaa7e4-3e17-4630-9234-b9641c0aaab1-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6c285637-f884-4ae8-87a8-b242fbce4a8f tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-8371b145-dcb6-4440-80e8-44febe4f4537-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:19 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Flow 'volume_create_manager' (ab1b8e45-d334-423e-83d4-0141f64e9b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccbfbc8-0be1-4311-ab68-6a39361d2a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccbfbc8-0be1-4311-ab68-6a39361d2a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1278163240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5a9b64fa87d6435f978c1c2739673868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:37:19Z,use_quota=True,user_id='f951baa241224a6195a7f54eb5e99758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286dd63e-30a3-43da-b439-893b5a88ec27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286dd63e-30a3-43da-b439-893b5a88ec27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d69629-ba6e-4df5-ab28-e4fdc9bf1533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d69629-ba6e-4df5-ab28-e4fdc9bf1533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1', 'volume_name': 'volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee0e504-dc7b-41be-a1b5-b324624d178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee0e504-dc7b-41be-a1b5-b324624d178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0912e096-5ae4-4a06-899e-cd8611ce13d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:19 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Volume 7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1', 'volume_size': 1} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1278163240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5a9b64fa87d6435f978c1c2739673868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:37:19Z,use_quota=True,user_id='f951baa241224a6195a7f54eb5e99758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Creating volume 7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:37:19 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:37:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:19 devstack quobyte-client[83739]: System call of process 95641 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:37:19 devstack quobyte-client[83739]: System call of process 95641 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:37:19 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=86, name=volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:37:20 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "cinder-quobyte-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1 1073741824" returned: 0 in 0.471s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1" returned: 0 in 0.148s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] <== create_volume: return (652ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" acquired by "delete_volume" :: waited 0.361s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0912e096-5ae4-4a06-899e-cd8611ce13d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d51063-f7cc-4744-a394-5341a97aa56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ae364f-8af4-4edf-9b50-ac381e2633da]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:20 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Volume volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1 (7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1): created successfully Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d51063-f7cc-4744-a394-5341a97aa56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Flow 'volume_create_manager' (ab1b8e45-d334-423e-83d4-0141f64e9b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:37:20 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-147b0a55-8ba1-4244-9349-2c1029df585d tempest-VolumesListTestJSON-801485030 None] Created volume successfully. Sep 17 18:37:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" returned: 0 in 0.517s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" returned: 0 in 0.099s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-quobyte-b8eaa7e4-3e17-4630-9234-b9641c0aaab1" released by "delete_volume" :: held 0.869s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:21 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Created reservations ['14f899ae-f893-443d-b11c-94492a121e4f', '9f5a6719-0137-4c31-8f9f-5690c839f41a', '9df7528d-65f9-467f-8a2c-a29ad69a35b4', '914ea2d3-8598-49de-ba3c-e10ce4afda90'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:37:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.363s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:37:22 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Deleted volume successfully. Sep 17 18:37:22 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Flow 'volume_create_manager' (382f680b-83a6-46af-90e7-da47704865d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b36110-4958-4312-9f59-66529e9fad2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b36110-4958-4312-9f59-66529e9fad2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-555321977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a25833a-3a9c-45e9-9006-1d8d322961be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5a9b64fa87d6435f978c1c2739673868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:37:22Z,use_quota=True,user_id='f951baa241224a6195a7f54eb5e99758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de1a3b6-5556-4b7b-933b-ca5227cd751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de1a3b6-5556-4b7b-933b-ca5227cd751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21585e0b-a9c0-4f03-b82e-932afc0e0e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21585e0b-a9c0-4f03-b82e-932afc0e0e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a25833a-3a9c-45e9-9006-1d8d322961be', 'volume_name': 'volume-0a25833a-3a9c-45e9-9006-1d8d322961be', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d1e4d9-4842-4c35-a90b-7bd2f7f218bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d1e4d9-4842-4c35-a90b-7bd2f7f218bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8794e6-f240-435d-a848-cf329a0b6a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:22 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Volume 0a25833a-3a9c-45e9-9006-1d8d322961be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a25833a-3a9c-45e9-9006-1d8d322961be', 'volume_size': 1} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-555321977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a25833a-3a9c-45e9-9006-1d8d322961be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5a9b64fa87d6435f978c1c2739673868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:37:22Z,use_quota=True,user_id='f951baa241224a6195a7f54eb5e99758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Creating volume 0a25833a-3a9c-45e9-9006-1d8d322961be {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:37:22 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0a25833a-3a9c-45e9-9006-1d8d322961be 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:22 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=87, name=volume-0a25833a-3a9c-45e9-9006-1d8d322961be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-3d0d334f-389d-4f15-8c65-a981bf447225 tempest-SnapshotDependencyTests-759710262 None] Lock "cinder-b8eaa7e4-3e17-4630-9234-b9641c0aaab1-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0a25833a-3a9c-45e9-9006-1d8d322961be 1073741824" returned: 0 in 0.351s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0a25833a-3a9c-45e9-9006-1d8d322961be {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0a25833a-3a9c-45e9-9006-1d8d322961be" returned: 0 in 0.126s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] <== create_volume: return (597ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:37:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.613s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8794e6-f240-435d-a848-cf329a0b6a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a25833a-3a9c-45e9-9006-1d8d322961be', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897cfd9e-678e-4af1-b402-55ea45ea163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:23 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Volume volume-0a25833a-3a9c-45e9-9006-1d8d322961be (0a25833a-3a9c-45e9-9006-1d8d322961be): created successfully Sep 17 18:37:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897cfd9e-678e-4af1-b402-55ea45ea163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Flow 'volume_create_manager' (382f680b-83a6-46af-90e7-da47704865d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:37:23 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-e3e7cf50-d590-4d8b-932f-3ddf362eb19a tempest-VolumesListTestJSON-801485030 None] Created volume successfully. Sep 17 18:37:24 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Flow 'volume_create_manager' (92ddf25f-d801-4cc5-8d83-4bc322942c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7434d1-76b5-4f7c-9437-c4acc71cda4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7434d1-76b5-4f7c-9437-c4acc71cda4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-98339163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526f618b-0df5-4cc2-9b8f-bd43838ec714,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5a9b64fa87d6435f978c1c2739673868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:37:24Z,use_quota=True,user_id='f951baa241224a6195a7f54eb5e99758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173dc35b-5e00-455a-abb5-ecf5eab97f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173dc35b-5e00-455a-abb5-ecf5eab97f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29353afe-9d16-443c-bc42-025d9115e01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29353afe-9d16-443c-bc42-025d9115e01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '526f618b-0df5-4cc2-9b8f-bd43838ec714', 'volume_name': 'volume-526f618b-0df5-4cc2-9b8f-bd43838ec714', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423581c6-50fb-4f00-ad88-e40eaae84512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423581c6-50fb-4f00-ad88-e40eaae84512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0aeb66-470f-42ea-afaa-82e183d20b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:24 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Volume 526f618b-0df5-4cc2-9b8f-bd43838ec714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-526f618b-0df5-4cc2-9b8f-bd43838ec714', 'volume_size': 1} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-98339163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526f618b-0df5-4cc2-9b8f-bd43838ec714,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5a9b64fa87d6435f978c1c2739673868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:37:24Z,use_quota=True,user_id='f951baa241224a6195a7f54eb5e99758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Creating volume 526f618b-0df5-4cc2-9b8f-bd43838ec714 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:37:24 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:37:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-526f618b-0df5-4cc2-9b8f-bd43838ec714 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:25 devstack quobyte-client[83739]: System call of process 95662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:37:25 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=88, name=volume-526f618b-0df5-4cc2-9b8f-bd43838ec714, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:37:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-526f618b-0df5-4cc2-9b8f-bd43838ec714 1073741824" returned: 0 in 0.520s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-526f618b-0df5-4cc2-9b8f-bd43838ec714 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-526f618b-0df5-4cc2-9b8f-bd43838ec714" returned: 0 in 0.155s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] <== create_volume: return (798ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:37:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0aeb66-470f-42ea-afaa-82e183d20b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-526f618b-0df5-4cc2-9b8f-bd43838ec714', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d9bead-d783-43a6-ac02-de05dc09f126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:26 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Volume volume-526f618b-0df5-4cc2-9b8f-bd43838ec714 (526f618b-0df5-4cc2-9b8f-bd43838ec714): created successfully Sep 17 18:37:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d9bead-d783-43a6-ac02-de05dc09f126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Flow 'volume_create_manager' (92ddf25f-d801-4cc5-8d83-4bc322942c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:37:26 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-fecd64f8-a235-4fd5-88f4-2e3632e14fd0 tempest-VolumesListTestJSON-801485030 None] Created volume successfully. Sep 17 18:37:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Acquiring lock "cinder-526f618b-0df5-4cc2-9b8f-bd43838ec714-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-526f618b-0df5-4cc2-9b8f-bd43838ec714-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:30 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Acquiring lock "cinder-quobyte-526f618b-0df5-4cc2-9b8f-bd43838ec714" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-quobyte-526f618b-0df5-4cc2-9b8f-bd43838ec714" acquired by "delete_volume" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:30 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd2d4da-79c5-4adc-b3c4-045450f5fc1f]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:37:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-526f618b-0df5-4cc2-9b8f-bd43838ec714 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-526f618b-0df5-4cc2-9b8f-bd43838ec714" returned: 0 in 0.504s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-526f618b-0df5-4cc2-9b8f-bd43838ec714 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-526f618b-0df5-4cc2-9b8f-bd43838ec714" returned: 0 in 0.111s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-quobyte-526f618b-0df5-4cc2-9b8f-bd43838ec714" released by "delete_volume" :: held 0.794s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:31 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Created reservations ['40847559-cad7-443f-b2f3-2a526627a1c7', '73f46b88-0a32-4f0b-81a6-c686f8c038d8', '72a344f8-6d21-4312-a720-c8649a5b93e2', 'c3426d77-440a-4c2f-acd5-8d367a09b18f'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:37:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.199s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:32 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:37:32 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Deleted volume successfully. Sep 17 18:37:32 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-4a20618e-7841-415d-97ea-11880748711b req-f16adb86-65d9-4279-ab3b-827682133ebe tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-82881615-b57f-4d38-a0dd-42fa934ae9b0 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-526f618b-0df5-4cc2-9b8f-bd43838ec714-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-4a20618e-7841-415d-97ea-11880748711b req-f16adb86-65d9-4279-ab3b-827682133ebe tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:33 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-4a20618e-7841-415d-97ea-11880748711b req-f16adb86-65d9-4279-ab3b-827682133ebe tempest-AttachVolumeTestJSON-315441114 None] Terminate volume connection completed successfully. Sep 17 18:37:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-4a20618e-7841-415d-97ea-11880748711b req-f16adb86-65d9-4279-ab3b-827682133ebe tempest-AttachVolumeTestJSON-315441114 None] Deleting attachment 619e9c2b-440a-403b-bd66-c4d17ccdeed9. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:37:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Acquiring lock "cinder-0a25833a-3a9c-45e9-9006-1d8d322961be-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-0a25833a-3a9c-45e9-9006-1d8d322961be-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Acquiring lock "cinder-quobyte-0a25833a-3a9c-45e9-9006-1d8d322961be" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-quobyte-0a25833a-3a9c-45e9-9006-1d8d322961be" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:33 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[22af57b5-3dda-4f6a-a705-338568cf9e54]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:37:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0a25833a-3a9c-45e9-9006-1d8d322961be {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0a25833a-3a9c-45e9-9006-1d8d322961be" returned: 0 in 0.449s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0a25833a-3a9c-45e9-9006-1d8d322961be {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0a25833a-3a9c-45e9-9006-1d8d322961be" returned: 0 in 0.108s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:34 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-quobyte-0a25833a-3a9c-45e9-9006-1d8d322961be" released by "delete_volume" :: held 0.726s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:34 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Created reservations ['dfbfe484-e3d4-45b3-abe4-64e5d720e75a', 'e2e51578-da83-4767-af90-090854ac3873', '27cd9d08-81e6-416f-8809-035787846847', '5503c90a-7438-4f69-bba2-3a8c59b97a6c'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:37:34 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=40,cinder:UPDATE=55,cinder:DELETE=7,cinder:INSERT=10 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:37:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.236s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:35 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:37:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Deleted volume successfully. Sep 17 18:37:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2ae8d803-1619-4a96-a7a8-ad02c53d1ec8 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-0a25833a-3a9c-45e9-9006-1d8d322961be-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Acquiring lock "cinder-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Acquiring lock "cinder-quobyte-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:37:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-quobyte-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1" acquired by "delete_volume" :: waited 0.010s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:37:36 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef55d3c-8881-4166-b969-6cc4612b4030]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:37:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:36 devstack quobyte-client[83739]: System call of process 95680 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:37:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1" returned: 0 in 0.685s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1" returned: 0 in 0.183s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-quobyte-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1" released by "delete_volume" :: held 1.070s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:37 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Created reservations ['921eb45c-7497-44f2-8606-9fdb53d8e796', '0f9ed13d-9909-4980-b805-ab59791028c3', '1db607b5-0b45-46d3-b392-10b58e51faa4', 'dc23f0f3-f71e-440c-9c17-1dd0c50c704a'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:37:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.101s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:37 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:37:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Deleted volume successfully. Sep 17 18:37:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c69b1202-b951-4495-8a6c-08528eacb8e9 tempest-VolumesListTestJSON-801485030 None] Lock "cinder-7b8c6e03-d0dd-4c43-9567-1a3ded2c7dc1-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:37:41 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Flow 'volume_create_manager' (310cbd0e-1033-4343-935e-f9fb2c7ade7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5348ad86-a581-4283-ac4e-5dfb17ee8fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5348ad86-a581-4283-ac4e-5dfb17ee8fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2037690202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c9989a-6cf6-4f0e-a98b-b90bf193c453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad992cf5c614fdfbc7192543b66f499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:37:41Z,use_quota=True,user_id='03dc3887a6fb4b59a1b837c547b54130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f39cd4-3bdb-4108-964c-28c23e402e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f39cd4-3bdb-4108-964c-28c23e402e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98133db-3bad-4935-a6bc-06e16cd45f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98133db-3bad-4935-a6bc-06e16cd45f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17c9989a-6cf6-4f0e-a98b-b90bf193c453', 'volume_name': 'volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3db9e5-f324-48a3-b5b5-857306a13a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3db9e5-f324-48a3-b5b5-857306a13a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67229799-9dca-4c75-8983-7a4f4effaf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:41 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Volume 17c9989a-6cf6-4f0e-a98b-b90bf193c453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453', 'volume_size': 1} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2037690202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c9989a-6cf6-4f0e-a98b-b90bf193c453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad992cf5c614fdfbc7192543b66f499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:37:41Z,use_quota=True,user_id='03dc3887a6fb4b59a1b837c547b54130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Creating volume 17c9989a-6cf6-4f0e-a98b-b90bf193c453 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:37:41 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:37:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:41 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=89, name=volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:37:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453 1073741824" returned: 0 in 0.321s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:37:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453" returned: 0 in 0.100s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:37:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] <== create_volume: return (479ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:37:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.490s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:37:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67229799-9dca-4c75-8983-7a4f4effaf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8659ca12-cd62-4139-81c4-dd457a6c2ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:37:42 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Volume volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453 (17c9989a-6cf6-4f0e-a98b-b90bf193c453): created successfully Sep 17 18:37:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8659ca12-cd62-4139-81c4-dd457a6c2ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:37:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Flow 'volume_create_manager' (310cbd0e-1033-4343-935e-f9fb2c7ade7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:37:42 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-943e460a-3468-4cf1-928a-24d523128850 tempest-VolumesNegativeTest-531330913 None] Created volume successfully. Sep 17 18:37:52 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=41,cinder:INSERT=12,cinder:UPDATE=59,cinder:DELETE=5 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:37:52 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:37:57 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-fa8e663d-22d7-4637-b2fb-9bf22ee0c6d1 req-cff7c86d-e814-4645-b428-5916f33fc794 tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:57 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-fa8e663d-22d7-4637-b2fb-9bf22ee0c6d1 req-cff7c86d-e814-4645-b428-5916f33fc794 tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:37:57 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-fa8e663d-22d7-4637-b2fb-9bf22ee0c6d1 req-cff7c86d-e814-4645-b428-5916f33fc794 tempest-AttachVolumeTestJSON-315441114 None] Terminate volume connection completed successfully. Sep 17 18:37:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-fa8e663d-22d7-4637-b2fb-9bf22ee0c6d1 req-cff7c86d-e814-4645-b428-5916f33fc794 tempest-AttachVolumeTestJSON-315441114 None] Deleting attachment a3f9a6f1-2930-4487-93ed-7b63c474e570. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:38:07 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:38:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "cinder-5308996f-943d-4133-b0fa-6b6cd8a96909-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-5308996f-943d-4133-b0fa-6b6cd8a96909-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "cinder-quobyte-5308996f-943d-4133-b0fa-6b6cd8a96909" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-quobyte-5308996f-943d-4133-b0fa-6b6cd8a96909" acquired by "delete_volume" :: waited 0.021s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:13 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[491466b3-140f-4c1c-a9f1-d6dc6c803d38]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5308996f-943d-4133-b0fa-6b6cd8a96909 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5308996f-943d-4133-b0fa-6b6cd8a96909" returned: 0 in 0.453s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5308996f-943d-4133-b0fa-6b6cd8a96909 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5308996f-943d-4133-b0fa-6b6cd8a96909" returned: 0 in 0.088s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-quobyte-5308996f-943d-4133-b0fa-6b6cd8a96909" released by "delete_volume" :: held 0.742s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:14 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Created reservations ['9afd0c38-c3b8-42dc-826a-92cd1d7f8db2', 'd926aeb5-1077-4d0a-b444-0c342007bcd0', '4bbf53bf-fc72-46ab-9026-4b6c959feadf', '134ead98-e171-4e55-9756-3331221005ed'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:38:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:38:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:38:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.155s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:14 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:38:14 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Deleted volume successfully. Sep 17 18:38:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6733cedf-fee3-471c-b0fb-38caeae9c9e2 tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-5308996f-943d-4133-b0fa-6b6cd8a96909-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "cinder-c42ac199-c254-44e0-81c8-900e10c25baf-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-c42ac199-c254-44e0-81c8-900e10c25baf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:15 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "cinder-quobyte-c42ac199-c254-44e0-81c8-900e10c25baf" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-quobyte-c42ac199-c254-44e0-81c8-900e10c25baf" acquired by "delete_volume" :: waited 0.020s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:15 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b71f04f-1dff-44e3-aca8-4cbcd0c9b1ad]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c42ac199-c254-44e0-81c8-900e10c25baf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c42ac199-c254-44e0-81c8-900e10c25baf" returned: 0 in 0.405s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c42ac199-c254-44e0-81c8-900e10c25baf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c42ac199-c254-44e0-81c8-900e10c25baf" returned: 0 in 0.152s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-quobyte-c42ac199-c254-44e0-81c8-900e10c25baf" released by "delete_volume" :: held 0.752s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Created reservations ['09e69298-ff60-4d89-ac10-054f3a5b173e', '21e2c6e8-1308-47b7-82cb-8bf9457c5227', '3e681f9a-3ef4-48e5-8067-02789f582bb8', 'fdac5aa3-a146-4017-9ecb-b3fc162882e2'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.103s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:38:16 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Deleted volume successfully. Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.172s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:38:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4ff4a20f-7331-4777-b257-1da4ee79e15a tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-c42ac199-c254-44e0-81c8-900e10c25baf-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "cinder-8f3a5707-f40d-4220-98d9-b0c52e695e87-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-8f3a5707-f40d-4220-98d9-b0c52e695e87-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:17 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "cinder-quobyte-8f3a5707-f40d-4220-98d9-b0c52e695e87" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-quobyte-8f3a5707-f40d-4220-98d9-b0c52e695e87" acquired by "delete_volume" :: waited 0.012s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:17 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1288a0fb-70d2-4c6c-9494-7093c333b2bb]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8f3a5707-f40d-4220-98d9-b0c52e695e87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8f3a5707-f40d-4220-98d9-b0c52e695e87" returned: 0 in 0.420s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8f3a5707-f40d-4220-98d9-b0c52e695e87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8f3a5707-f40d-4220-98d9-b0c52e695e87" returned: 0 in 0.082s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-quobyte-8f3a5707-f40d-4220-98d9-b0c52e695e87" released by "delete_volume" :: held 0.651s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:18 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Created reservations ['abf39bc2-04be-4509-9c3f-d2a936c8d599', '57be4a50-67c2-4f6f-88eb-f1fef870c2bb', '67065397-1d3c-4fe3-9aec-641b58636014', '2bffec84-e59e-40a8-9343-809104ad8f73'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:38:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:38:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:38:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.094s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:19 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:38:19 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Deleted volume successfully. Sep 17 18:38:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-efc5b643-6b5c-43d9-bde8-155109d2a9f6 tempest-AttachVolumeTestJSON-315441114 None] Lock "cinder-8f3a5707-f40d-4220-98d9-b0c52e695e87-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Acquiring lock "cinder-17c9989a-6cf6-4f0e-a98b-b90bf193c453-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Lock "cinder-17c9989a-6cf6-4f0e-a98b-b90bf193c453-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:27 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Acquiring lock "cinder-quobyte-17c9989a-6cf6-4f0e-a98b-b90bf193c453" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Lock "cinder-quobyte-17c9989a-6cf6-4f0e-a98b-b90bf193c453" acquired by "delete_volume" :: waited 0.012s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:27 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef080458-5697-4844-a693-ba4fcd953c26]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453" returned: 0 in 0.462s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-17c9989a-6cf6-4f0e-a98b-b90bf193c453" returned: 0 in 0.122s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Lock "cinder-quobyte-17c9989a-6cf6-4f0e-a98b-b90bf193c453" released by "delete_volume" :: held 0.771s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:28 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Created reservations ['251aae60-9a8b-44ad-a2c9-578d435c8b11', 'fd418cb4-9db9-4520-94bf-62393ce150ac', 'e2bb595e-f1a8-4bd6-ae4b-fdf176cbb1e9', 'cb607ba6-497c-444e-bd6b-cf2361c5eca3'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:38:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:38:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:38:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.099s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:28 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:38:28 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Deleted volume successfully. Sep 17 18:38:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a43e5b41-377c-4a5c-9c64-ff31fab94a71 tempest-VolumesNegativeTest-531330913 None] Lock "cinder-17c9989a-6cf6-4f0e-a98b-b90bf193c453-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:30 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Flow 'volume_create_manager' (815d15d0-b5b4-44ce-a443-198d96b78cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1b8096-cf86-40a8-8890-21e6df46041a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1b8096-cf86-40a8-8890-21e6df46041a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1387859407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b41eac-6861-49bd-b61d-8905df5daaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2da84364fb42908775558aa1ef14ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:38:30Z,use_quota=True,user_id='b915e6ad9b2244b59697438382de94c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775ba545-f191-4e13-9bf7-e62eccd119ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775ba545-f191-4e13-9bf7-e62eccd119ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447e2b10-b5b0-4acb-b3d5-9b3b7c8907f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447e2b10-b5b0-4acb-b3d5-9b3b7c8907f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b41eac-6861-49bd-b61d-8905df5daaf1', 'volume_name': 'volume-c9b41eac-6861-49bd-b61d-8905df5daaf1', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b26a86-6f38-4166-a722-32cb1790eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b26a86-6f38-4166-a722-32cb1790eac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d30fcce-4a7b-407d-a1ee-3ef5839ed2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:30 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Volume c9b41eac-6861-49bd-b61d-8905df5daaf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b41eac-6861-49bd-b61d-8905df5daaf1', 'volume_size': 1} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1387859407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b41eac-6861-49bd-b61d-8905df5daaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2da84364fb42908775558aa1ef14ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:38:30Z,use_quota=True,user_id='b915e6ad9b2244b59697438382de94c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Creating volume c9b41eac-6861-49bd-b61d-8905df5daaf1 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:38:30 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:30 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=90, name=volume-c9b41eac-6861-49bd-b61d-8905df5daaf1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 1073741824" returned: 0 in 0.342s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1" returned: 0 in 0.093s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] <== create_volume: return (526ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:38:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.537s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d30fcce-4a7b-407d-a1ee-3ef5839ed2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b41eac-6861-49bd-b61d-8905df5daaf1', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d1fad9-4dbb-47b5-ac6c-f0d24b9052c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:31 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Volume volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 (c9b41eac-6861-49bd-b61d-8905df5daaf1): created successfully Sep 17 18:38:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d1fad9-4dbb-47b5-ac6c-f0d24b9052c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Flow 'volume_create_manager' (815d15d0-b5b4-44ce-a443-198d96b78cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:38:31 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-95331e31-7469-4ddf-bae1-ef0c58a517a6 req-e5ffd453-7977-4e3e-9e5c-277ff7cb8b00 tempest-VolumesSnapshotsTestJSON-1826672808 None] Created volume successfully. Sep 17 18:38:32 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Flow 'volume_create_manager' (df020224-9dbf-4398-8930-b2202c89a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d5f716-7fd2-462c-a4ff-fdc04cebeb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d5f716-7fd2-462c-a4ff-fdc04cebeb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1960682811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27138c3d-a797-42ec-a27c-74bfe3816ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4aee490d634da284004f6cd36c8bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:38:32Z,use_quota=True,user_id='7d1ccec33c5c4302b8ff8ced753d128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5323574-4249-4fdc-924f-ef3e28c705b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5323574-4249-4fdc-924f-ef3e28c705b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f743fd-1927-4bda-8ed1-070a6699984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f743fd-1927-4bda-8ed1-070a6699984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27138c3d-a797-42ec-a27c-74bfe3816ef4', 'volume_name': 'volume-27138c3d-a797-42ec-a27c-74bfe3816ef4', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96437b3-6485-4c8d-b925-5f75a9fde133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96437b3-6485-4c8d-b925-5f75a9fde133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e285ee9d-ef2b-48c8-84bc-358f397bfb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:32 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Volume 27138c3d-a797-42ec-a27c-74bfe3816ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27138c3d-a797-42ec-a27c-74bfe3816ef4', 'volume_size': 1} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1960682811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27138c3d-a797-42ec-a27c-74bfe3816ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4aee490d634da284004f6cd36c8bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:38:32Z,use_quota=True,user_id='7d1ccec33c5c4302b8ff8ced753d128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Creating volume 27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:38:32 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:32 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=91, name=volume-27138c3d-a797-42ec-a27c-74bfe3816ef4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 1073741824" returned: 0 in 0.461s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4" returned: 0 in 0.181s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] <== create_volume: return (670ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.123s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Creating offline snapshot 3a922cdb-483f-45f6-bbd1-aeba7d598d5b of volume c9b41eac-6861-49bd-b61d-8905df5daaf1 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e285ee9d-ef2b-48c8-84bc-358f397bfb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27138c3d-a797-42ec-a27c-74bfe3816ef4', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416c14c7-0353-4f8e-87ee-d76c64212c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3511fa-943e-402a-b3ad-44953e9a2a4d]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:33 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Volume volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 (27138c3d-a797-42ec-a27c-74bfe3816ef4): created successfully Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416c14c7-0353-4f8e-87ee-d76c64212c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Flow 'volume_create_manager' (df020224-9dbf-4398-8930-b2202c89a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:38:33 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-153eaab9-67fd-4d9e-9397-4da93f7aca84 tempest-VolumesSnapshotListTestJSON-24313206 None] Created volume successfully. Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1" returned: 0 in 0.492s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:34 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=92, name=volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:38:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b 1G" returned: 0 in 0.233s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "qemu-img rebase -u -b volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b" returned: 0 in 0.154s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:38:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b" returned: 0 in 0.094s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:38:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b" returned: 0 in 0.356s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.info" returned: 0 in 0.212s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.info" returned: 0 in 0.102s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.268s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Creating offline snapshot 25858abd-fedb-447a-b4f5-9c19a65c205e of volume 27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:38:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-88738f96-72a5-4b3b-8e67-2b619411e058 req-33a9c912-8d51-45ab-93ae-78856971ad73 tempest-VolumesSnapshotsTestJSON-1826672808 None] Create snapshot completed successfully Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c95cbee-73ec-476a-9ecd-d84965fead35]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4" returned: 0 in 0.445s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:36 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=94, name=volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e 1G" returned: 0 in 0.264s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): qemu-img rebase -u -b volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Acquiring lock "cinder-3a922cdb-483f-45f6-bbd1-aeba7d598d5b-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "qemu-img rebase -u -b volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e" returned: 0 in 0.261s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e" returned: 0 in 0.151s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "cinder-3a922cdb-483f-45f6-bbd1-aeba7d598d5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.367s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:36 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Acquiring lock "cinder-quobyte-c9b41eac-6861-49bd-b61d-8905df5daaf1" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e" returned: 0 in 0.207s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.info" returned: 0 in 0.190s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "cinder-quobyte-c9b41eac-6861-49bd-b61d-8905df5daaf1" acquired by "delete_snapshot" :: waited 0.393s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Acquiring lock "cinder-quobyte-3a922cdb-483f-45f6-bbd1-aeba7d598d5b" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.info" returned: 0 in 0.214s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "cinder-quobyte-3a922cdb-483f-45f6-bbd1-aeba7d598d5b" acquired by "_delete_snapshot" :: waited 0.210s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Deleting offline snapshot 3a922cdb-483f-45f6-bbd1-aeba7d598d5b of volume c9b41eac-6861-49bd-b61d-8905df5daaf1 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] snapshot_file for this snap is: volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a52d53-f468-4c10-96ae-ed15310928d8]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6420697b-e5f5-4d0e-80ca-c30ed8ba4603 tempest-VolumesSnapshotListTestJSON-24313206 None] Create snapshot completed successfully Sep 17 18:38:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b" returned: 0 in 0.488s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9b41eac-6861-49bd-b61d-8905df5daaf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:38:38 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41a15cc-d7ce-434a-bfed-f9330d314f0b]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1" returned: 0 in 0.384s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:38 devstack quobyte-client[83739]: System call of process 95992 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:38:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b" returned: 0 in 0.227s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1.3a922cdb-483f-45f6-bbd1-aeba7d598d5b" returned: 0 in 0.108s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "cinder-quobyte-3a922cdb-483f-45f6-bbd1-aeba7d598d5b" released by "_delete_snapshot" :: held 1.806s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "cinder-quobyte-c9b41eac-6861-49bd-b61d-8905df5daaf1" released by "delete_snapshot" :: held 2.078s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:39 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:39 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Creating offline snapshot 32623305-048f-48d0-a4e4-cc8d2285e29e of volume 27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:38:39 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c9b1f0-f9c0-471f-94f2-2dfc36a45501]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:39 devstack cinder-volume[83736]: DEBUG cinder.quota [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Created reservations ['6fd40256-27e5-49f0-9cfd-014940974eb8', 'bfb3ea7f-ea46-44aa-9ee1-ff365f56ff56', '1570af01-6a05-4788-ab77-7d73fccf6bd2', '58d8687c-4a9b-4dea-b2ae-c5e1c31e69e3'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e" returned: 0 in 0.549s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27138c3d-a797-42ec-a27c-74bfe3816ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:40 devstack quobyte-client[83739]: System call of process 95999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:38:40 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Delete snapshot completed successfully. Sep 17 18:38:40 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=96, name=volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-20a29b1b-134e-4612-ae97-1c62caf79391 req-df484e00-7329-41ab-a9f7-a4fb10f748df tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "cinder-3a922cdb-483f-45f6-bbd1-aeba7d598d5b-delete_snapshot" released by "delete_snapshot" :: held 3.484s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e 1G" returned: 0 in 0.321s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): qemu-img rebase -u -b volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "qemu-img rebase -u -b volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e" returned: 0 in 0.125s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e" returned: 0 in 0.097s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e" returned: 0 in 0.104s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.418s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Acquiring lock "cinder-c9b41eac-6861-49bd-b61d-8905df5daaf1-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "cinder-c9b41eac-6861-49bd-b61d-8905df5daaf1-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:41 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-21f29f5e-67d9-4ace-84df-73dd5d680041 tempest-VolumesSnapshotListTestJSON-24313206 None] Create snapshot completed successfully Sep 17 18:38:41 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Acquiring lock "cinder-quobyte-c9b41eac-6861-49bd-b61d-8905df5daaf1" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "cinder-quobyte-c9b41eac-6861-49bd-b61d-8905df5daaf1" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:41 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8670911-04ab-4dcc-95b9-e07ab6289c5a]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1" returned: 0 in 0.397s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c9b41eac-6861-49bd-b61d-8905df5daaf1" returned: 0 in 0.102s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "cinder-quobyte-c9b41eac-6861-49bd-b61d-8905df5daaf1" released by "delete_volume" :: held 0.690s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG cinder.quota [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Created reservations ['c473d6ad-8f6f-4281-b7a3-8857d6ca0188', 'c46fa0bb-e8b7-431b-a912-f3842c9f1fe2', '1861cff1-a077-4b46-828f-4f8e9dca9d92', 'a8a96b2f-2eea-4b1e-8bd5-85565145576a'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.366s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG cinder.manager [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:38:42 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:42 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Deleted volume successfully. Sep 17 18:38:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Creating offline snapshot 74fc6f5f-1d34-4864-8de4-1e968f2192cd of volume 27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:38:43 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd69d1d5-9a27-4917-a0b3-bb23cf3ac279]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:43 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-cd353661-4e0d-413b-8da8-9b895c3addc6 req-49ad808f-55a2-40a2-be32-fd19af8f70f3 tempest-VolumesSnapshotsTestJSON-1826672808 None] Lock "cinder-c9b41eac-6861-49bd-b61d-8905df5daaf1-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e" returned: 0 in 0.645s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27138c3d-a797-42ec-a27c-74bfe3816ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:38:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:43 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=97, name=volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:38:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd 1G" returned: 0 in 0.378s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): qemu-img rebase -u -b volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:44 devstack quobyte-client[83739]: System call of process 96018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:38:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "qemu-img rebase -u -b volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd" returned: 0 in 0.167s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:38:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd" returned: 0 in 0.137s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:38:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd" returned: 0 in 0.105s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.751s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-09c1b2be-cc6d-4808-af78-159b3c7db609 tempest-VolumesSnapshotListTestJSON-24313206 None] Create snapshot completed successfully Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "cinder-74fc6f5f-1d34-4864-8de4-1e968f2192cd-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-74fc6f5f-1d34-4864-8de4-1e968f2192cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:49 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "cinder-quobyte-74fc6f5f-1d34-4864-8de4-1e968f2192cd" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-74fc6f5f-1d34-4864-8de4-1e968f2192cd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Deleting offline snapshot 74fc6f5f-1d34-4864-8de4-1e968f2192cd of volume 27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] snapshot_file for this snap is: volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9848b3fc-52a0-4865-a97d-4aec9d19c2e1]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd" returned: 0 in 0.410s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27138c3d-a797-42ec-a27c-74bfe3816ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e63887-fa36-4693-9210-01b37336a3b8]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:50 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c69c5c8d-4e7f-4102-b764-3f841fffdbef tempest-GroupsV320Test-2116262209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:50 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c69c5c8d-4e7f-4102-b764-3f841fffdbef tempest-GroupsV320Test-2116262209 None] Group tempest-GroupsV320Test-Group-757980557: creating Sep 17 18:38:50 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c69c5c8d-4e7f-4102-b764-3f841fffdbef tempest-GroupsV320Test-2116262209 None] Group tempest-GroupsV320Test-Group-757980557: created successfully Sep 17 18:38:50 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c69c5c8d-4e7f-4102-b764-3f841fffdbef tempest-GroupsV320Test-2116262209 None] Create group completed successfully. Sep 17 18:38:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e" returned: 0 in 0.542s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27138c3d-a797-42ec-a27c-74bfe3816ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:38:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:50 devstack quobyte-client[83739]: System call of process 96031 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:38:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd" returned: 0 in 0.265s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.74fc6f5f-1d34-4864-8de4-1e968f2192cd" returned: 0 in 0.085s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-74fc6f5f-1d34-4864-8de4-1e968f2192cd" released by "_delete_snapshot" :: held 1.573s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" released by "delete_snapshot" :: held 1.625s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:51 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Created reservations ['d5db6137-07ad-4290-86af-9b228183cd63', '9c84881d-a499-4850-bdfa-fdf2a9ffb378', '59670a6e-147d-4077-acb7-69d8d1a007c3', 'a27a4ca3-45ef-43d2-b939-88f300be275f'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:38:51 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Delete snapshot completed successfully. Sep 17 18:38:51 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-11d7199e-3252-40c2-a773-1795f8f64df8 tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-74fc6f5f-1d34-4864-8de4-1e968f2192cd-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:51 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1baf15d8-4b0e-474e-a8a3-753f85f877b7 tempest-GroupsV320Test-2116262209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:51 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-1baf15d8-4b0e-474e-a8a3-753f85f877b7 tempest-GroupsV320Test-2116262209 None] Created reservations ['15907ffa-56a1-475f-9f4a-e6fb4694d8bc'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:38:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1baf15d8-4b0e-474e-a8a3-753f85f877b7 tempest-GroupsV320Test-2116262209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:38:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1baf15d8-4b0e-474e-a8a3-753f85f877b7 tempest-GroupsV320Test-2116262209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:38:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1baf15d8-4b0e-474e-a8a3-753f85f877b7 tempest-GroupsV320Test-2116262209 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:38:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1baf15d8-4b0e-474e-a8a3-753f85f877b7 tempest-GroupsV320Test-2116262209 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:38:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1baf15d8-4b0e-474e-a8a3-753f85f877b7 tempest-GroupsV320Test-2116262209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:38:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1baf15d8-4b0e-474e-a8a3-753f85f877b7 tempest-GroupsV320Test-2116262209 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1baf15d8-4b0e-474e-a8a3-753f85f877b7 tempest-GroupsV320Test-2116262209 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.107s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:51 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-1baf15d8-4b0e-474e-a8a3-753f85f877b7 tempest-GroupsV320Test-2116262209 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:38:51 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1baf15d8-4b0e-474e-a8a3-753f85f877b7 tempest-GroupsV320Test-2116262209 None] Delete group completed successfully. Sep 17 18:38:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "cinder-32623305-048f-48d0-a4e4-cc8d2285e29e-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-32623305-048f-48d0-a4e4-cc8d2285e29e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:52 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "cinder-quobyte-32623305-048f-48d0-a4e4-cc8d2285e29e" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:52 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-32623305-048f-48d0-a4e4-cc8d2285e29e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Deleting offline snapshot 32623305-048f-48d0-a4e4-cc8d2285e29e of volume 27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:38:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] snapshot_file for this snap is: volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:38:52 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fdf358-7805-43f3-b0c1-cd6604ddd9de]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e" returned: 0 in 0.512s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:53 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27138c3d-a797-42ec-a27c-74bfe3816ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:38:53 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[77709c08-3548-4c4c-bbbd-1c38fc0fb57a]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e" returned: 0 in 0.428s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:53 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27138c3d-a797-42ec-a27c-74bfe3816ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:38:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e" returned: 0 in 0.223s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.32623305-048f-48d0-a4e4-cc8d2285e29e" returned: 0 in 0.095s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-32623305-048f-48d0-a4e4-cc8d2285e29e" released by "_delete_snapshot" :: held 1.695s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" released by "delete_snapshot" :: held 1.720s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:54 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Created reservations ['cad5be9c-5cd4-4490-bfcd-9b984945fd39', '8413c1e8-58d1-45cd-80b4-d7fcd048f3c4', '8fbcbcc1-8fa5-4107-95d0-e270c0c4d6b2', '25f5fe8d-ff00-4511-8b09-05e1b8ca64f2'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:38:54 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Delete snapshot completed successfully. Sep 17 18:38:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e80ce976-bab2-4d37-8891-f68f30a5884b tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-32623305-048f-48d0-a4e4-cc8d2285e29e-delete_snapshot" released by "delete_snapshot" :: held 2.364s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "cinder-25858abd-fedb-447a-b4f5-9c19a65c205e-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-25858abd-fedb-447a-b4f5-9c19a65c205e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:55 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "cinder-quobyte-25858abd-fedb-447a-b4f5-9c19a65c205e" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-25858abd-fedb-447a-b4f5-9c19a65c205e" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:55 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Deleting offline snapshot 25858abd-fedb-447a-b4f5-9c19a65c205e of volume 27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:38:55 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] snapshot_file for this snap is: volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:38:55 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4661045e-b499-4524-823e-44a0bdc848b0]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e" returned: 0 in 0.438s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27138c3d-a797-42ec-a27c-74bfe3816ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:38:56 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[02673681-fe93-4133-8be6-971d9fbc8172]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4" returned: 0 in 0.583s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e" returned: 0 in 0.280s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4.25858abd-fedb-447a-b4f5-9c19a65c205e" returned: 0 in 0.094s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-25858abd-fedb-447a-b4f5-9c19a65c205e" released by "_delete_snapshot" :: held 1.750s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" released by "delete_snapshot" :: held 1.798s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:57 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Created reservations ['c566f99e-dab8-4df5-bee1-a9ef5ab17142', '63bdc321-a251-4a33-8cd4-23fe9334fa90', '0b23cbef-c5ae-45eb-9a48-2019b5a930c4', '7228da47-9369-4612-90df-50dd58ea1d3d'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:38:57 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Delete snapshot completed successfully. Sep 17 18:38:58 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-67a6d7bd-04f6-4f3a-ba10-d102514121bb tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-25858abd-fedb-447a-b4f5-9c19a65c205e-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:38:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "cinder-27138c3d-a797-42ec-a27c-74bfe3816ef4-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-27138c3d-a797-42ec-a27c-74bfe3816ef4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:59 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:38:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:38:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:38:59 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[38534e00-c138-4b46-938a-39157b61054d]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:38:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4" returned: 0 in 0.390s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:38:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-27138c3d-a797-42ec-a27c-74bfe3816ef4" returned: 0 in 0.108s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:38:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-quobyte-27138c3d-a797-42ec-a27c-74bfe3816ef4" released by "delete_volume" :: held 0.654s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:39:00 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Created reservations ['09f7c4c6-b782-4f1d-9608-00e49aa6a283', 'fe7404e6-e673-4022-84f4-72f1a2c07538', '9e9d2af1-c132-4ade-b2cc-d2105756721c', '7e1d4c2b-7bce-4762-b836-cbc6d2f4d569'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:39:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:00 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:39:00 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:39:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.109s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:00 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:39:00 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Deleted volume successfully. Sep 17 18:39:00 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7833dd12-4ccc-47f3-a1fe-f1764c980dab tempest-VolumesSnapshotListTestJSON-24313206 None] Lock "cinder-27138c3d-a797-42ec-a27c-74bfe3816ef4-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:39:09 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Flow 'volume_create_manager' (98c74b79-70f2-4ae3-9e07-87e258898532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5286cc8a-05b7-438a-8dc5-48eac2d6d9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=64,cinder:INSERT=13,cinder:UPDATE=72,cinder:DELETE=5 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5286cc8a-05b7-438a-8dc5-48eac2d6d9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1621597041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2eefcb6-bead-4043-a407-3f458da56521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80db55ef58ad423fae502485e1e559a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:39:09Z,use_quota=True,user_id='5cf4f14b4163491a87e99d6f773dd679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4e999c-eac0-47fa-96f8-5bdb65b5ea66),volume_type_id=3a4e999c-eac0-47fa-96f8-5bdb65b5ea66)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66cbe374-d260-48a5-9aa2-312a4b6ecfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66cbe374-d260-48a5-9aa2-312a4b6ecfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc30af7-6cb3-4c17-973d-74bcd79fcea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc30af7-6cb3-4c17-973d-74bcd79fcea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2eefcb6-bead-4043-a407-3f458da56521', 'volume_name': 'volume-f2eefcb6-bead-4043-a407-3f458da56521', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c413c8b-8793-4b74-9ec1-e473e2097ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c413c8b-8793-4b74-9ec1-e473e2097ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88884f60-47bb-419b-84ff-9d625a6dd7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:09 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Volume f2eefcb6-bead-4043-a407-3f458da56521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2eefcb6-bead-4043-a407-3f458da56521', 'volume_size': 1} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1621597041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2eefcb6-bead-4043-a407-3f458da56521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80db55ef58ad423fae502485e1e559a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:39:09Z,use_quota=True,user_id='5cf4f14b4163491a87e99d6f773dd679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4e999c-eac0-47fa-96f8-5bdb65b5ea66),volume_type_id=3a4e999c-eac0-47fa-96f8-5bdb65b5ea66)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Creating volume f2eefcb6-bead-4043-a407-3f458da56521 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:39:09 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:39:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2eefcb6-bead-4043-a407-3f458da56521 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:10 devstack quobyte-client[83739]: System call of process 96068 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:39:10 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=98, name=volume-f2eefcb6-bead-4043-a407-3f458da56521, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:39:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2eefcb6-bead-4043-a407-3f458da56521 1073741824" returned: 0 in 0.661s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2eefcb6-bead-4043-a407-3f458da56521 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2eefcb6-bead-4043-a407-3f458da56521" returned: 0 in 0.225s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] <== create_volume: return (985ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:39:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88884f60-47bb-419b-84ff-9d625a6dd7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2eefcb6-bead-4043-a407-3f458da56521', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65a3496-4c6e-48c3-967e-1735a9f8b15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:11 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Volume volume-f2eefcb6-bead-4043-a407-3f458da56521 (f2eefcb6-bead-4043-a407-3f458da56521): created successfully Sep 17 18:39:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65a3496-4c6e-48c3-967e-1735a9f8b15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Flow 'volume_create_manager' (98c74b79-70f2-4ae3-9e07-87e258898532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:39:11 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d75c5413-be3e-4243-9e6f-256ba46434fb tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Created volume successfully. Sep 17 18:39:11 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-87b95062-6bbd-4343-b85b-02eef4222c9e tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:39:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-87b95062-6bbd-4343-b85b-02eef4222c9e tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-87b95062-6bbd-4343-b85b-02eef4222c9e tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-87b95062-6bbd-4343-b85b-02eef4222c9e tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:39:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-87b95062-6bbd-4343-b85b-02eef4222c9e tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:39:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-87b95062-6bbd-4343-b85b-02eef4222c9e tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-87b95062-6bbd-4343-b85b-02eef4222c9e tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-87b95062-6bbd-4343-b85b-02eef4222c9e tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.153s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:12 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-87b95062-6bbd-4343-b85b-02eef4222c9e tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:39:12 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-87b95062-6bbd-4343-b85b-02eef4222c9e tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Retype volume completed successfully. Sep 17 18:39:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Acquiring lock "cinder-f2eefcb6-bead-4043-a407-3f458da56521-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:39:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "cinder-f2eefcb6-bead-4043-a407-3f458da56521-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:39:13 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=71,cinder:UPDATE=96,cinder:INSERT=28,cinder:DELETE=7 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:39:13 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:39:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Acquiring lock "cinder-quobyte-f2eefcb6-bead-4043-a407-3f458da56521" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:39:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "cinder-quobyte-f2eefcb6-bead-4043-a407-3f458da56521" acquired by "delete_volume" :: waited 0.014s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:39:13 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c955dc52-1156-4e7a-9ae6-679f5c9095ca]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:39:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2eefcb6-bead-4043-a407-3f458da56521 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2eefcb6-bead-4043-a407-3f458da56521" returned: 0 in 0.518s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2eefcb6-bead-4043-a407-3f458da56521 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f2eefcb6-bead-4043-a407-3f458da56521" returned: 0 in 0.121s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "cinder-quobyte-f2eefcb6-bead-4043-a407-3f458da56521" released by "delete_volume" :: held 0.834s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:39:14 devstack cinder-volume[83736]: WARNING cinder.quota [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:39:14 devstack cinder-volume[83736]: WARNING cinder.quota [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:39:14 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Created reservations ['c4e801cd-3c55-4951-b115-cf335dc5bc4d', 'e9d95cbf-0bf5-486a-9c3e-1465f2700cb3', '52a5ac44-23e9-4d38-a5d0-b90d22eda7f2', '2a9d9315-e99d-46eb-b2ea-398eacf4ef21'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:39:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:39:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:39:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.133s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:15 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:39:15 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Deleted volume successfully. Sep 17 18:39:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-04241f19-9a07-42c3-9490-9b5a6db0a7d7 tempest-VolumeRetypeWithoutMigrationTest-1952803103 None] Lock "cinder-f2eefcb6-bead-4043-a407-3f458da56521-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:39:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:39:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:39:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:39:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.204s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:39:28 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:39:28 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=16,cinder:DELETE=2,cinder:SELECT=11,cinder:INSERT=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:39:36 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Flow 'volume_create_manager' (6662073d-50cd-4229-87c3-499a4e253c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e017b354-36ec-41f3-a45d-9c56687c38d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e017b354-36ec-41f3-a45d-9c56687c38d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-528658783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342f9c4a-5bb3-490a-9e1c-a3a13e010ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ab295c732449b0a4593b9730dc8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:39:36Z,use_quota=True,user_id='3c9d98ab386b48ab98c5db8e9c72b3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4af6988a-d09e-4b96-b747-76048bb5a43f),volume_type_id=4af6988a-d09e-4b96-b747-76048bb5a43f)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c64422-bf9b-49fa-9666-ccdeb654ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c64422-bf9b-49fa-9666-ccdeb654ead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8976a7de-74a1-4a8a-a35d-35d1e101c51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8976a7de-74a1-4a8a-a35d-35d1e101c51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342f9c4a-5bb3-490a-9e1c-a3a13e010ea3', 'volume_name': 'volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ec9acb-81e9-4dfc-bba3-471c914aa482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ec9acb-81e9-4dfc-bba3-471c914aa482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3923317-ea3a-4a3c-b573-28460d42e06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:36 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume 342f9c4a-5bb3-490a-9e1c-a3a13e010ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3', 'volume_size': 1} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-528658783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342f9c4a-5bb3-490a-9e1c-a3a13e010ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ab295c732449b0a4593b9730dc8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:39:36Z,use_quota=True,user_id='3c9d98ab386b48ab98c5db8e9c72b3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4af6988a-d09e-4b96-b747-76048bb5a43f),volume_type_id=4af6988a-d09e-4b96-b747-76048bb5a43f)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Creating volume 342f9c4a-5bb3-490a-9e1c-a3a13e010ea3 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:39:36 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:39:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:36 devstack quobyte-client[83739]: System call of process 96121 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:39:36 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=99, name=volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3 1073741824" returned: 0 in 0.538s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:37 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Flow 'volume_create_manager' (2aad7ccc-a334-4868-b3c5-d71b1c7cbe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d9aa42-3ace-49ce-b56e-91ba3d8bcfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3" returned: 0 in 0.528s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] <== create_volume: return (1099ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d9aa42-3ace-49ce-b56e-91ba3d8bcfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1201886657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67566ba-0501-4368-a769-d05269c1db17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ab295c732449b0a4593b9730dc8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:39:37Z,use_quota=True,user_id='3c9d98ab386b48ab98c5db8e9c72b3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7817aa3e-b25b-478a-903f-578cd56a104f),volume_type_id=7817aa3e-b25b-478a-903f-578cd56a104f)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c42bc-e072-4fe5-8673-a48ff4c2ad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c42bc-e072-4fe5-8673-a48ff4c2ad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb556d06-b860-4e67-986d-bd1420c987cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb556d06-b860-4e67-986d-bd1420c987cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f67566ba-0501-4368-a769-d05269c1db17', 'volume_name': 'volume-f67566ba-0501-4368-a769-d05269c1db17', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d422bf8-e49b-4e2b-a2b4-2d0b12c3a04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d422bf8-e49b-4e2b-a2b4-2d0b12c3a04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b523bc-f118-486e-8cfe-275070a951a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:37 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Volume f67566ba-0501-4368-a769-d05269c1db17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f67566ba-0501-4368-a769-d05269c1db17', 'volume_size': 1} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1201886657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67566ba-0501-4368-a769-d05269c1db17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ab295c732449b0a4593b9730dc8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:39:37Z,use_quota=True,user_id='3c9d98ab386b48ab98c5db8e9c72b3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7817aa3e-b25b-478a-903f-578cd56a104f),volume_type_id=7817aa3e-b25b-478a-903f-578cd56a104f)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Creating volume f67566ba-0501-4368-a769-d05269c1db17 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:39:37 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:39:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f67566ba-0501-4368-a769-d05269c1db17 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:38 devstack quobyte-client[83739]: System call of process 96125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:39:38 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=100, name=volume-f67566ba-0501-4368-a769-d05269c1db17, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3923317-ea3a-4a3c-b573-28460d42e06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54c5380-7516-4020-b16b-b2334392f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:38 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3 (342f9c4a-5bb3-490a-9e1c-a3a13e010ea3): created successfully Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54c5380-7516-4020-b16b-b2334392f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Flow 'volume_create_manager' (6662073d-50cd-4229-87c3-499a4e253c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f67566ba-0501-4368-a769-d05269c1db17 1073741824" returned: 0 in 0.559s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f67566ba-0501-4368-a769-d05269c1db17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:38 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Flow 'volume_create_manager' (f593aa83-ace7-43f7-b5af-163fce438578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48190fcc-1dbb-48c0-89d1-151f659d75f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48190fcc-1dbb-48c0-89d1-151f659d75f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-10779703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e63ebd-ceaa-4b7f-975a-9b881c543586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ab295c732449b0a4593b9730dc8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:39:38Z,use_quota=True,user_id='3c9d98ab386b48ab98c5db8e9c72b3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(603b188d-ef60-4dd3-977f-ce7669f8fce8),volume_type_id=603b188d-ef60-4dd3-977f-ce7669f8fce8)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95dcc28c-2f86-40bf-9a58-4a0226a9cfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95dcc28c-2f86-40bf-9a58-4a0226a9cfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df52ebcb-731b-4583-aeaf-a6fb43715702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG cinder.image.glance [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Creating Keystone auth plugin from conf {{(pid=83736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f67566ba-0501-4368-a769-d05269c1db17" returned: 0 in 0.565s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] <== create_volume: return (1158ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-743ba3fb-067e-4577-8fc8-acf8bc0dc710 tempest-TestInstancesWithCinderVolumes-634386560 None] Created volume successfully. Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b523bc-f118-486e-8cfe-275070a951a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67566ba-0501-4368-a769-d05269c1db17', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3e079a-c7a6-46d3-b392-056d91e0f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:39 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Volume volume-f67566ba-0501-4368-a769-d05269c1db17 (f67566ba-0501-4368-a769-d05269c1db17): created successfully Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3e079a-c7a6-46d3-b392-056d91e0f456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Flow 'volume_create_manager' (2aad7ccc-a334-4868-b3c5-d71b1c7cbe4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df52ebcb-731b-4583-aeaf-a6fb43715702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30e63ebd-ceaa-4b7f-975a-9b881c543586', 'volume_name': 'volume-30e63ebd-ceaa-4b7f-975a-9b881c543586', 'volume_size': 1, 'image_id': '36322267-e5d1-48f4-8d72-648810661c56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36322267-e5d1-48f4-8d72-648810661c56', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1971408984', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46ab295c732449b0a4593b9730dc8a76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36322267-e5d1-48f4-8d72-648810661c56', 'created_at': datetime.datetime(2025, 9, 17, 16, 39, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 39, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36322267-e5d1-48f4-8d72-648810661c56/file', 'properties': {}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705de052-ffe3-496d-a046-545a79160855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705de052-ffe3-496d-a046-545a79160855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3843724d-4a60-46fd-9d25-b9c4184100eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:39 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Volume 30e63ebd-ceaa-4b7f-975a-9b881c543586: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30e63ebd-ceaa-4b7f-975a-9b881c543586', 'volume_size': 1, 'image_id': '36322267-e5d1-48f4-8d72-648810661c56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36322267-e5d1-48f4-8d72-648810661c56', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1971408984', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46ab295c732449b0a4593b9730dc8a76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36322267-e5d1-48f4-8d72-648810661c56', 'created_at': datetime.datetime(2025, 9, 17, 16, 39, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 39, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36322267-e5d1-48f4-8d72-648810661c56/file', 'properties': {}}, 'image_service': } Sep 17 18:39:39 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Cloning 30e63ebd-ceaa-4b7f-975a-9b881c543586 from image 36322267-e5d1-48f4-8d72-648810661c56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36322267-e5d1-48f4-8d72-648810661c56', 'metadata': {}}]). {{(pid=83736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 17 18:39:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-66519a00-51c5-4444-8976-3f9274d08a8e tempest-TestInstancesWithCinderVolumes-634386560 None] Created volume successfully. Sep 17 18:39:42 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD, size 20.69 MB, duration 2.79 sec {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 18:39:42 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Image download 20.69 MB at 7.40 MB/s Sep 17 18:39:42 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdbac0c-e7b7-4e87-9186-647a15f284f5]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:39:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:42 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD Sep 17 18:39:42 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:39:44 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Sep 17 18:39:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD" returned: 0 in 2.540s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:45 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Temporary image 36322267-e5d1-48f4-8d72-648810661c56 is fetched for user 3c9d98ab386b48ab98c5db8e9c72b3d0. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 18:39:45 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe865f7-33e1-41e8-bd5d-5dc0334cd7d0]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:39:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:45 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD Sep 17 18:39:45 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:39:47 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD" returned: 0 in 2.233s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-10779703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e63ebd-ceaa-4b7f-975a-9b881c543586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ab295c732449b0a4593b9730dc8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:39:38Z,use_quota=True,user_id='3c9d98ab386b48ab98c5db8e9c72b3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(603b188d-ef60-4dd3-977f-ce7669f8fce8),volume_type_id=603b188d-ef60-4dd3-977f-ce7669f8fce8)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Creating volume 30e63ebd-ceaa-4b7f-975a-9b881c543586 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:39:47 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:39:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:47 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=101, name=volume-30e63ebd-ceaa-4b7f-975a-9b881c543586, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:39:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 1073741824" returned: 0 in 0.423s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586" returned: 0 in 0.154s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] <== create_volume: return (703ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:39:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:39:48 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Attempting download of 36322267-e5d1-48f4-8d72-648810661c56 ((None, [{'url': 'file:///opt/stack/data/glance/images/36322267-e5d1-48f4-8d72-648810661c56', 'metadata': {}}])) to volume 30e63ebd-ceaa-4b7f-975a-9b881c543586. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 18:39:48 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a8689d-1f31-4322-ba97-737bfaf0943b]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:39:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36322267-e5d1-48f4-8d72-648810661c56_x1q0puwz {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36322267-e5d1-48f4-8d72-648810661c56_x1q0puwz" returned: 0 in 0.502s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36322267-e5d1-48f4-8d72-648810661c56_x1q0puwz {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36322267-e5d1-48f4-8d72-648810661c56_x1q0puwz" returned: 1 in 0.401s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36322267-e5d1-48f4-8d72-648810661c56_x1q0puwz' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:39:49 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[db90364b-ec5a-4a29-8b6c-fdea4ad348a3]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:39:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD" returned: 0 in 0.449s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:50 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] 36322267-e5d1-48f4-8d72-648810661c56 was qcow2, converting to raw {{(pid=83736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 18:39:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:50 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=101, name=volume-30e63ebd-ceaa-4b7f-975a-9b881c543586, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:39:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586" returned: 0 in 1.099s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:51 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36322267-e5d1-48f4-8d72-648810661c56__pthj7g0devstack@QuobyteHD, size 112.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:39:51 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Converted 112.00 MB image at 97.79 MB/s Sep 17 18:39:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 1G" returned: 0 in 0.148s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:51 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b8ab56-937b-4365-a3d9-c15d856beb72]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:39:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586" returned: 0 in 0.421s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:39:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586" returned: 1 in 0.459s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:39:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:39:52 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Downloaded image 36322267-e5d1-48f4-8d72-648810661c56 ((None, [{'url': 'file:///opt/stack/data/glance/images/36322267-e5d1-48f4-8d72-648810661c56', 'metadata': {}}])) to volume 30e63ebd-ceaa-4b7f-975a-9b881c543586 successfully. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 18:39:52 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Temporary image 36322267-e5d1-48f4-8d72-648810661c56 for user 3c9d98ab386b48ab98c5db8e9c72b3d0 is deleted. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 18:39:52 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Marking volume 30e63ebd-ceaa-4b7f-975a-9b881c543586 as bootable. {{(pid=83736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 18:39:53 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Copying metadata from image 36322267-e5d1-48f4-8d72-648810661c56 to 30e63ebd-ceaa-4b7f-975a-9b881c543586. {{(pid=83736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 18:39:53 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Creating volume glance metadata for volume 30e63ebd-ceaa-4b7f-975a-9b881c543586 backed by image 36322267-e5d1-48f4-8d72-648810661c56 with: {'image_id': '36322267-e5d1-48f4-8d72-648810661c56', 'image_name': 'tempest-scenario-img--1971408984', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 18:39:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3843724d-4a60-46fd-9d25-b9c4184100eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e63ebd-ceaa-4b7f-975a-9b881c543586', 'volume_size': 1, 'image_id': '36322267-e5d1-48f4-8d72-648810661c56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36322267-e5d1-48f4-8d72-648810661c56', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1971408984', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46ab295c732449b0a4593b9730dc8a76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36322267-e5d1-48f4-8d72-648810661c56', 'created_at': datetime.datetime(2025, 9, 17, 16, 39, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 39, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36322267-e5d1-48f4-8d72-648810661c56/file', 'properties': {}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33aa7df1-e855-4fac-9859-9697c016d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:39:53 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Volume volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 (30e63ebd-ceaa-4b7f-975a-9b881c543586): created successfully Sep 17 18:39:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33aa7df1-e855-4fac-9859-9697c016d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:39:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Flow 'volume_create_manager' (f593aa83-ace7-43f7-b5af-163fce438578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:39:53 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-850f792b-46e9-4a32-b564-effb5b4742fa tempest-TestInstancesWithCinderVolumes-634386560 None] Created volume successfully. Sep 17 18:40:03 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:40:03 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7,cinder:DELETE=2,cinder:INSERT=5 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:40:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-478a3abf-e525-4831-b815-0876b43d4fcd req-0c383d8c-5a9f-43c8-a475-1986d8de7325 tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:40:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-478a3abf-e525-4831-b815-0876b43d4fcd req-0c383d8c-5a9f-43c8-a475-1986d8de7325 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:40:06 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf84c5b-22fb-4b06-83e8-907582618850]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:40:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-478a3abf-e525-4831-b815-0876b43d4fcd req-0c383d8c-5a9f-43c8-a475-1986d8de7325 tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:07 devstack quobyte-client[83739]: System call of process 96184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:40:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-478a3abf-e525-4831-b815-0876b43d4fcd req-0c383d8c-5a9f-43c8-a475-1986d8de7325 tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586" returned: 0 in 0.418s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-478a3abf-e525-4831-b815-0876b43d4fcd req-0c383d8c-5a9f-43c8-a475-1986d8de7325 tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-478a3abf-e525-4831-b815-0876b43d4fcd req-0c383d8c-5a9f-43c8-a475-1986d8de7325 tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586" returned: 1 in 0.390s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-478a3abf-e525-4831-b815-0876b43d4fcd req-0c383d8c-5a9f-43c8-a475-1986d8de7325 tempest-TestInstancesWithCinderVolumes-634386560 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:40:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-478a3abf-e525-4831-b815-0876b43d4fcd req-0c383d8c-5a9f-43c8-a475-1986d8de7325 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.935s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:40:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-478a3abf-e525-4831-b815-0876b43d4fcd req-0c383d8c-5a9f-43c8-a475-1986d8de7325 tempest-TestInstancesWithCinderVolumes-634386560 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-30e63ebd-ceaa-4b7f-975a-9b881c543586', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd865a881-58b7-44f7-9670-435ab78a93c0', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:40:07 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-478a3abf-e525-4831-b815-0876b43d4fcd req-0c383d8c-5a9f-43c8-a475-1986d8de7325 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:40:08 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-478a3abf-e525-4831-b815-0876b43d4fcd req-0c383d8c-5a9f-43c8-a475-1986d8de7325 tempest-TestInstancesWithCinderVolumes-634386560 None] attachment_update completed successfully. Sep 17 18:40:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:40:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:40:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:40:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:40:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:40:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:40:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.105s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:40:18 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:40:18 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=4 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:40:32 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:40:32 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (80985d94-e8e2-4532-8465-2d16ce318aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f57284-740b-476a-90e5-50f0a11c4056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f57284-740b-476a-90e5-50f0a11c4056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-119452718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69996c9a-c38e-4144-936d-c11c695b3bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:40:33Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d722d462-6f6a-42cb-ab61-bef4887b22a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d722d462-6f6a-42cb-ab61-bef4887b22a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb66d01-43ef-47f8-8600-5bbf16d80190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb66d01-43ef-47f8-8600-5bbf16d80190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69996c9a-c38e-4144-936d-c11c695b3bf9', 'volume_name': 'volume-69996c9a-c38e-4144-936d-c11c695b3bf9', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0586c4fe-4914-4c73-835f-2b549712c7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0586c4fe-4914-4c73-835f-2b549712c7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8e49ed-a126-4ce4-8685-5209deb8a9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:33 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Volume 69996c9a-c38e-4144-936d-c11c695b3bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69996c9a-c38e-4144-936d-c11c695b3bf9', 'volume_size': 1} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-119452718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69996c9a-c38e-4144-936d-c11c695b3bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:40:33Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Creating volume 69996c9a-c38e-4144-936d-c11c695b3bf9 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:40:33 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:40:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-69996c9a-c38e-4144-936d-c11c695b3bf9 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:33 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=102, name=volume-69996c9a-c38e-4144-936d-c11c695b3bf9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:40:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-69996c9a-c38e-4144-936d-c11c695b3bf9 1073741824" returned: 0 in 0.911s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-69996c9a-c38e-4144-936d-c11c695b3bf9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-69996c9a-c38e-4144-936d-c11c695b3bf9" returned: 0 in 0.288s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] <== create_volume: return (1382ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:40:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:40:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8e49ed-a126-4ce4-8685-5209deb8a9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69996c9a-c38e-4144-936d-c11c695b3bf9', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02826cd1-79bf-42b5-b2b2-8c3bf4f43aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:35 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Volume volume-69996c9a-c38e-4144-936d-c11c695b3bf9 (69996c9a-c38e-4144-936d-c11c695b3bf9): created successfully Sep 17 18:40:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02826cd1-79bf-42b5-b2b2-8c3bf4f43aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (80985d94-e8e2-4532-8465-2d16ce318aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:40:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7ee4d3cd-d3bd-41cb-bfa1-601a7df3c704 tempest-VolumesActionsTest-1156879959 None] Created volume successfully. Sep 17 18:40:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2d07b3c7-7ca2-4458-b9e9-2966caf466de tempest-VolumesActionsTest-1156879959 None] Acquiring lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9" by "attach_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:40:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2d07b3c7-7ca2-4458-b9e9-2966caf466de tempest-VolumesActionsTest-1156879959 None] Lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9" acquired by "attach_volume" :: waited 0.174s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:40:37 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2d07b3c7-7ca2-4458-b9e9-2966caf466de tempest-VolumesActionsTest-1156879959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:40:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2d07b3c7-7ca2-4458-b9e9-2966caf466de tempest-VolumesActionsTest-1156879959 None] Attaching volume 69996c9a-c38e-4144-936d-c11c695b3bf9 to instance 5b4e8202-5120-4f00-aa84-d43e43f975cb at mountpoint /dev/vdb on host None. Sep 17 18:40:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2d07b3c7-7ca2-4458-b9e9-2966caf466de tempest-VolumesActionsTest-1156879959 None] Attach volume completed successfully. Sep 17 18:40:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2d07b3c7-7ca2-4458-b9e9-2966caf466de tempest-VolumesActionsTest-1156879959 None] Lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9" released by "attach_volume" :: held 0.679s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:40:38 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-90cdb90b-646a-4a9c-80e4-029cd475b4ec tempest-VolumesActionsTest-1060130718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:40:38 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-90cdb90b-646a-4a9c-80e4-029cd475b4ec tempest-VolumesActionsTest-1060130718 None] Terminate volume connection completed successfully. Sep 17 18:40:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-90cdb90b-646a-4a9c-80e4-029cd475b4ec tempest-VolumesActionsTest-1060130718 None] Acquiring lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9-detach_volume" by "detach_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:40:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-90cdb90b-646a-4a9c-80e4-029cd475b4ec tempest-VolumesActionsTest-1060130718 None] Lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:40:39 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-90cdb90b-646a-4a9c-80e4-029cd475b4ec tempest-VolumesActionsTest-1060130718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:40:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-90cdb90b-646a-4a9c-80e4-029cd475b4ec tempest-VolumesActionsTest-1060130718 None] Detaching volume 69996c9a-c38e-4144-936d-c11c695b3bf9 from instance 5b4e8202-5120-4f00-aa84-d43e43f975cb. Sep 17 18:40:39 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-90cdb90b-646a-4a9c-80e4-029cd475b4ec tempest-VolumesActionsTest-1060130718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:40:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-90cdb90b-646a-4a9c-80e4-029cd475b4ec tempest-VolumesActionsTest-1060130718 None] Detach volume completed successfully. Sep 17 18:40:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-90cdb90b-646a-4a9c-80e4-029cd475b4ec tempest-VolumesActionsTest-1060130718 None] Lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9-detach_volume" released by "detach_volume" :: held 0.130s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:40:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8000b1b2-454d-412a-884c-0ef431db6e62 tempest-VolumesActionsTest-1156879959 None] Acquiring lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9-detach_volume" by "detach_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:40:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8000b1b2-454d-412a-884c-0ef431db6e62 tempest-VolumesActionsTest-1156879959 None] Lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:40:40 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-8000b1b2-454d-412a-884c-0ef431db6e62 tempest-VolumesActionsTest-1156879959 None] Volume detach called, but volume not attached. Sep 17 18:40:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8000b1b2-454d-412a-884c-0ef431db6e62 tempest-VolumesActionsTest-1156879959 None] Lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:40:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Acquiring lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:40:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:40:41 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:40:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Acquiring lock "cinder-quobyte-69996c9a-c38e-4144-936d-c11c695b3bf9" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:40:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Lock "cinder-quobyte-69996c9a-c38e-4144-936d-c11c695b3bf9" acquired by "delete_volume" :: waited 0.034s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:40:41 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f877c2f0-cb4a-4e2e-83c8-2b35731cd543]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:40:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-69996c9a-c38e-4144-936d-c11c695b3bf9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:42 devstack quobyte-client[83739]: System call of process 96826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:40:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-69996c9a-c38e-4144-936d-c11c695b3bf9" returned: 0 in 1.014s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-69996c9a-c38e-4144-936d-c11c695b3bf9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-69996c9a-c38e-4144-936d-c11c695b3bf9" returned: 0 in 0.157s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:43 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Lock "cinder-quobyte-69996c9a-c38e-4144-936d-c11c695b3bf9" released by "delete_volume" :: held 1.571s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:40:43 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Created reservations ['be24ca01-93cf-4bb2-ae0c-1b536575255f', 'f69e6340-821e-4b2b-ad4c-35665aef97dd', '1ea71be1-efc3-48d4-a3a3-d89b57c6d746', 'e84fb31b-428e-4efb-8a6b-73a9cd10b181'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:40:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:40:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:40:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:40:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:40:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:40:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.211s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:44 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:40:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Deleted volume successfully. Sep 17 18:40:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f66f8b24-e87f-4830-a6d4-7006babd99dd tempest-VolumesActionsTest-1156879959 None] Lock "cinder-69996c9a-c38e-4144-936d-c11c695b3bf9-delete_volume" released by "delete_volume" :: held 4.013s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=12,cinder:UPDATE=19,cinder:INSERT=3 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:40:54 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (f1fcd22f-d95d-40e7-acd5-dcbeadf42ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627424c4-a14d-449c-ad5a-8fa9d929bf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627424c4-a14d-449c-ad5a-8fa9d929bf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-601812352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5324aadc-bebf-4c8f-a13c-2be4e3b62c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:40:54Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e954656e-6deb-40e4-91e7-7b209418a142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e954656e-6deb-40e4-91e7-7b209418a142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4324b706-fa37-4cce-b7c7-48e5180699d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4324b706-fa37-4cce-b7c7-48e5180699d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5324aadc-bebf-4c8f-a13c-2be4e3b62c9c', 'volume_name': 'volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25e6052-d7b6-4fe9-9e58-55a16b1aaf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25e6052-d7b6-4fe9-9e58-55a16b1aaf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8216a16b-315c-4c41-aa6f-5115395c51c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:54 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Volume 5324aadc-bebf-4c8f-a13c-2be4e3b62c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c', 'volume_size': 1} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-601812352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5324aadc-bebf-4c8f-a13c-2be4e3b62c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:40:54Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Creating volume 5324aadc-bebf-4c8f-a13c-2be4e3b62c9c {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:40:54 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:54 devstack quobyte-client[83739]: System call of process 96869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:40:54 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=103, name=volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c 1073741824" returned: 0 in 0.441s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c" returned: 0 in 0.130s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:55 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] <== create_volume: return (664ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:40:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:40:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8216a16b-315c-4c41-aa6f-5115395c51c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a01c637-2dcf-4d6d-9748-a4bf3ff70a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:55 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Volume volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c (5324aadc-bebf-4c8f-a13c-2be4e3b62c9c): created successfully Sep 17 18:40:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a01c637-2dcf-4d6d-9748-a4bf3ff70a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:55 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (f1fcd22f-d95d-40e7-acd5-dcbeadf42ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:40:55 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-cc1a53b4-056b-4913-a30e-14f6c82a4778 tempest-VolumesActionsTest-1156879959 None] Created volume successfully. Sep 17 18:40:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Acquiring lock "cinder-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:40:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:40:56 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:40:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Acquiring lock "cinder-quobyte-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:40:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-quobyte-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c" acquired by "delete_volume" :: waited 0.014s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:40:56 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bc97be-8624-425a-8d14-663b6aefa65d]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:40:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c" returned: 0 in 0.489s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c" returned: 0 in 0.088s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-quobyte-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c" released by "delete_volume" :: held 0.743s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:40:57 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Created reservations ['e3fa73e8-7986-42a2-b847-9b3703df85b2', 'f65eeb59-074e-4213-a830-a4ccd3a562e4', '9c6f72c3-6072-4280-8a98-c5211a8a5825', '53fedc48-8536-433b-85a3-f4d13fbb4229'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:40:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:40:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:40:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:40:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:40:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:40:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:40:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.123s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:40:58 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:40:58 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Deleted volume successfully. Sep 17 18:40:58 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-eedd90a0-a440-4f61-9fce-34af41668b45 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-5324aadc-bebf-4c8f-a13c-2be4e3b62c9c-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:40:59 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (e240c8c7-eaa5-4254-a6f9-30d3389ece5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d85ae6-75eb-4555-b20f-e72f183a1e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d85ae6-75eb-4555-b20f-e72f183a1e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2116431739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b839e10-9ad5-4e11-b1e4-e4c630edd091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:00Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c080c7f5-9af0-4896-94a4-f4edcf385229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c080c7f5-9af0-4896-94a4-f4edcf385229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c88b98-9838-4a60-b10e-89490f53a923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c88b98-9838-4a60-b10e-89490f53a923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b839e10-9ad5-4e11-b1e4-e4c630edd091', 'volume_name': 'volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983c6df0-8780-4ffd-be71-e5c55604b1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983c6df0-8780-4ffd-be71-e5c55604b1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8351fbc2-c65b-4b98-a8e4-b5628831e6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:40:59 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Volume 9b839e10-9ad5-4e11-b1e4-e4c630edd091: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091', 'volume_size': 1} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2116431739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b839e10-9ad5-4e11-b1e4-e4c630edd091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:00Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Creating volume 9b839e10-9ad5-4e11-b1e4-e4c630edd091 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:40:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:40:59 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:41:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:00 devstack quobyte-client[83739]: System call of process 96881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:41:00 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=104, name=volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:41:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091 1073741824" returned: 0 in 0.345s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091" returned: 0 in 0.189s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:00 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] <== create_volume: return (638ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:41:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8351fbc2-c65b-4b98-a8e4-b5628831e6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1bdac1-567d-45ed-85fb-e376089dee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:00 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Volume volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091 (9b839e10-9ad5-4e11-b1e4-e4c630edd091): created successfully Sep 17 18:41:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1bdac1-567d-45ed-85fb-e376089dee28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (e240c8c7-eaa5-4254-a6f9-30d3389ece5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:41:01 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1b596df7-6ae4-42cb-be2f-a66799c7ef14 tempest-VolumesActionsTest-1156879959 None] Created volume successfully. Sep 17 18:41:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Acquiring lock "cinder-9b839e10-9ad5-4e11-b1e4-e4c630edd091-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-9b839e10-9ad5-4e11-b1e4-e4c630edd091-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:02 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Acquiring lock "cinder-quobyte-9b839e10-9ad5-4e11-b1e4-e4c630edd091" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-quobyte-9b839e10-9ad5-4e11-b1e4-e4c630edd091" acquired by "delete_volume" :: waited 0.010s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:02 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d926c235-98c2-4943-865a-d39280028c86]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091" returned: 0 in 0.496s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9b839e10-9ad5-4e11-b1e4-e4c630edd091" returned: 0 in 0.093s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-quobyte-9b839e10-9ad5-4e11-b1e4-e4c630edd091" released by "delete_volume" :: held 0.796s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:03 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Created reservations ['28ab18af-35a2-42dd-ae1f-d273b78ec968', '9e26c10c-a945-46c4-b0e1-86a21913ef0a', 'aad57440-7b25-4010-ad0e-a697f9a7c431', 'ad67b6a4-b149-4aec-8462-1f62d6be6ce9'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:41:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:03 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:41:03 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:41:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.088s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:03 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:41:03 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Deleted volume successfully. Sep 17 18:41:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6d3a6fba-1f97-40ff-a445-1c9029d40722 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-9b839e10-9ad5-4e11-b1e4-e4c630edd091-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:04 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (23119f3c-176e-48ed-b078-c7a83cc3194c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a09d1da-6d53-40c5-8e97-2d0c73d776e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a09d1da-6d53-40c5-8e97-2d0c73d776e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1308708552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d0c190-7f4c-4307-bc91-1b5580b44962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:05Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd449f55-79e4-4fb9-8e68-d04816ccb87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd449f55-79e4-4fb9-8e68-d04816ccb87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3626acb-dfaa-44ea-a20e-62ffc70798d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3626acb-dfaa-44ea-a20e-62ffc70798d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d0c190-7f4c-4307-bc91-1b5580b44962', 'volume_name': 'volume-93d0c190-7f4c-4307-bc91-1b5580b44962', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a8766a-4495-4256-a8c2-73b3c94efc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a8766a-4495-4256-a8c2-73b3c94efc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacb0f1b-1351-49c0-8bf9-9878e49ba5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:05 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Volume 93d0c190-7f4c-4307-bc91-1b5580b44962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d0c190-7f4c-4307-bc91-1b5580b44962', 'volume_size': 1} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1308708552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d0c190-7f4c-4307-bc91-1b5580b44962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:05Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Creating volume 93d0c190-7f4c-4307-bc91-1b5580b44962 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:41:05 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93d0c190-7f4c-4307-bc91-1b5580b44962 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:05 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=105, name=volume-93d0c190-7f4c-4307-bc91-1b5580b44962, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93d0c190-7f4c-4307-bc91-1b5580b44962 1073741824" returned: 0 in 0.331s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93d0c190-7f4c-4307-bc91-1b5580b44962 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93d0c190-7f4c-4307-bc91-1b5580b44962" returned: 0 in 0.089s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] <== create_volume: return (494ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.506s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacb0f1b-1351-49c0-8bf9-9878e49ba5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d0c190-7f4c-4307-bc91-1b5580b44962', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:05 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9842bdbb-a9bd-436f-96cf-54a3757f45c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:05 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Volume volume-93d0c190-7f4c-4307-bc91-1b5580b44962 (93d0c190-7f4c-4307-bc91-1b5580b44962): created successfully Sep 17 18:41:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9842bdbb-a9bd-436f-96cf-54a3757f45c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (23119f3c-176e-48ed-b078-c7a83cc3194c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:41:06 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c34290c5-4d24-4887-9035-bb2d7009ad26 tempest-VolumesActionsTest-1156879959 None] Created volume successfully. Sep 17 18:41:07 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Acquiring lock "cinder-93d0c190-7f4c-4307-bc91-1b5580b44962-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:07 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-93d0c190-7f4c-4307-bc91-1b5580b44962-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:07 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:07 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Acquiring lock "cinder-quobyte-93d0c190-7f4c-4307-bc91-1b5580b44962" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:07 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-quobyte-93d0c190-7f4c-4307-bc91-1b5580b44962" acquired by "delete_volume" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:07 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[67977498-d100-4e31-b6b3-b3fc9d065efb]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93d0c190-7f4c-4307-bc91-1b5580b44962 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93d0c190-7f4c-4307-bc91-1b5580b44962" returned: 0 in 0.435s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93d0c190-7f4c-4307-bc91-1b5580b44962 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-93d0c190-7f4c-4307-bc91-1b5580b44962" returned: 0 in 0.122s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-quobyte-93d0c190-7f4c-4307-bc91-1b5580b44962" released by "delete_volume" :: held 0.714s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Created reservations ['67d8a5dd-ab97-4cd5-be3e-ba5469b8da0c', '52e8b902-7371-4944-83f0-690234e71653', '02edc7b8-cceb-4c37-912e-7cf6658e90e6', '48e7b02c-a6af-4456-9a88-593021c47fea'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.096s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:08 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:41:08 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Deleted volume successfully. Sep 17 18:41:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1f6ff880-3e76-4f24-8695-0d105fcafc01 tempest-VolumesActionsTest-1060130718 None] Lock "cinder-93d0c190-7f4c-4307-bc91-1b5580b44962-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:10 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (b793818c-8832-48a6-a65c-63a086d71797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc22509-a67c-435e-8958-a3752ea667e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc22509-a67c-435e-8958-a3752ea667e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31547804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:10Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da2f48f-9b03-4e27-bde5-e214af6196d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da2f48f-9b03-4e27-bde5-e214af6196d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4effbf-e540-48c7-afee-626856004425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4effbf-e540-48c7-afee-626856004425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a', 'volume_name': 'volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fe910e-6faf-4fc2-90ee-1cc0cbb40f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fe910e-6faf-4fc2-90ee-1cc0cbb40f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34601683-b168-4ff9-bcf1-6ea3416007fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:10 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Volume 6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a', 'volume_size': 1} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31547804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:10Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Creating volume 6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:41:10 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:10 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=106, name=volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a 1073741824" returned: 0 in 0.354s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a" returned: 0 in 0.094s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] <== create_volume: return (531ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:41:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.546s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34601683-b168-4ff9-bcf1-6ea3416007fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ccc34a-97ec-4bc2-8ae0-631a4124ef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:11 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Volume volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a (6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a): created successfully Sep 17 18:41:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ccc34a-97ec-4bc2-8ae0-631a4124ef89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (b793818c-8832-48a6-a65c-63a086d71797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:41:11 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-3317a94e-81d3-4c57-bfba-64372e27b2a9 tempest-VolumesActionsTest-1156879959 None] Created volume successfully. Sep 17 18:41:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Acquiring lock "cinder-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Lock "cinder-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Acquiring lock "cinder-quobyte-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Lock "cinder-quobyte-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a" acquired by "delete_volume" :: waited 0.018s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:12 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c627400-13cf-4aa9-872e-83f7bd638d39]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a" returned: 0 in 0.520s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a" returned: 0 in 0.128s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Lock "cinder-quobyte-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a" released by "delete_volume" :: held 0.859s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:13 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Created reservations ['132d23c2-93f9-45d9-b044-ba2e6c6da78a', 'ba20bf80-ef8d-4789-95b4-5fafa996ddea', 'c31c129b-3298-4ace-bf10-e65d833c8f2d', '6a9979fc-b4fe-404e-8944-6c799eaa48ec'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:41:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:41:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:41:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.114s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:14 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:41:14 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Deleted volume successfully. Sep 17 18:41:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7789253d-55a2-4f5b-bb6f-c68bc02ed26f tempest-VolumesActionsTest-1060130718 None] Lock "cinder-6c8a6c5a-9d1a-4df3-8c7a-8de9c175e52a-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:15 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (32dc6f1a-ca40-4a0e-b736-08c68f025721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286b9f08-0f2f-4bb5-8ab0-bbec9413478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286b9f08-0f2f-4bb5-8ab0-bbec9413478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1014633084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ac97e5-5c10-4bbd-b648-f7ba9f015b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:15Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6430d653-c3d5-4e67-9cd1-bce0c315a36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6430d653-c3d5-4e67-9cd1-bce0c315a36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9882463b-e8c4-4605-ab28-422afc331b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9882463b-e8c4-4605-ab28-422afc331b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ac97e5-5c10-4bbd-b648-f7ba9f015b4c', 'volume_name': 'volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b91e0b-6561-4438-811b-0768daccbcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b91e0b-6561-4438-811b-0768daccbcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371c4252-e104-4083-aa6b-91517bc28be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:15 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Volume 09ac97e5-5c10-4bbd-b648-f7ba9f015b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c', 'volume_size': 1} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1014633084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ac97e5-5c10-4bbd-b648-f7ba9f015b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fe9157283241979d75affc8c56929b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:15Z,use_quota=True,user_id='a2292313f4d34e4aa28c1bcf6a00bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Creating volume 09ac97e5-5c10-4bbd-b648-f7ba9f015b4c {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:41:15 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:15 devstack quobyte-client[83739]: System call of process 96956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:41:15 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=107, name=volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c 1073741824" returned: 0 in 0.351s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c" returned: 0 in 0.085s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] <== create_volume: return (509ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:41:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.522s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371c4252-e104-4083-aa6b-91517bc28be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115ac406-be70-460c-a61a-2c1867550e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:16 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Volume volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c (09ac97e5-5c10-4bbd-b648-f7ba9f015b4c): created successfully Sep 17 18:41:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115ac406-be70-460c-a61a-2c1867550e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Flow 'volume_create_manager' (32dc6f1a-ca40-4a0e-b736-08c68f025721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:41:16 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-b7d17ba2-5375-43ab-ad76-1fc73f2a618a tempest-VolumesActionsTest-1156879959 None] Created volume successfully. Sep 17 18:41:16 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:41:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:41:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:41:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.096s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:41:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Acquiring lock "cinder-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Lock "cinder-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:18 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Acquiring lock "cinder-quobyte-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Lock "cinder-quobyte-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c" acquired by "delete_volume" :: waited 0.010s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:18 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ac09c4-e59e-45ea-9499-3682481a1e4c]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c" returned: 0 in 0.464s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c" returned: 0 in 0.104s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Lock "cinder-quobyte-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c" released by "delete_volume" :: held 0.736s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Created reservations ['d0f96437-1b05-44e4-bd68-29256365693b', '0e6e015e-f72e-4326-b84f-2c16cd058b23', 'e3e0a035-4672-43de-8d6e-b7ee3ffce4b2', '81313486-82b9-4af7-a113-105f155ac907'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.089s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:41:19 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Deleted volume successfully. Sep 17 18:41:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4f9670ee-4b9f-44ec-b6a3-a7702282e28c tempest-VolumesActionsTest-1156879959 None] Lock "cinder-09ac97e5-5c10-4bbd-b648-f7ba9f015b4c-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:29 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=47,cinder:SELECT=49,cinder:DELETE=6,cinder:INSERT=16 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:41:29 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=62,cinder:SELECT=27,cinder:INSERT=7,cinder:DELETE=6 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:41:38 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Flow 'volume_create_manager' (d06ba378-e0d5-4ffc-82c2-1fa756e42b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09a159d-2abc-4ba5-8a92-b03eefc0e8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09a159d-2abc-4ba5-8a92-b03eefc0e8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-802625845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572923c04feb43d8b98a197556cc497f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:38Z,use_quota=True,user_id='40d78d1b5a154537ae034ee525968c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6701dd59-fb48-477a-b1f4-8348f764d19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6701dd59-fb48-477a-b1f4-8348f764d19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67c59cf-78a0-453e-bd76-9607195d4f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67c59cf-78a0-453e-bd76-9607195d4f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7', 'volume_name': 'volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3db7178-8edd-44d5-92cc-c6287284e063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3db7178-8edd-44d5-92cc-c6287284e063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437516ab-e1c7-4e52-9006-9bdf00f55dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:38 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Volume da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7', 'volume_size': 1} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-802625845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572923c04feb43d8b98a197556cc497f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:38Z,use_quota=True,user_id='40d78d1b5a154537ae034ee525968c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Creating volume da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:41:38 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:41:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:38 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=108, name=volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:41:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 1073741824" returned: 0 in 0.407s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7" returned: 0 in 0.124s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:39 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] <== create_volume: return (613ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:41:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.628s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437516ab-e1c7-4e52-9006-9bdf00f55dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4547cd-3ad0-4b53-892b-540753b0f23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:39 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Volume volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 (da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7): created successfully Sep 17 18:41:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4547cd-3ad0-4b53-892b-540753b0f23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:39 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Flow 'volume_create_manager' (d06ba378-e0d5-4ffc-82c2-1fa756e42b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:41:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7dedff64-0f10-4fbb-ae74-e9765bb13408 tempest-SnapshotMetadataTestJSON-1986055043 None] Created volume successfully. Sep 17 18:41:40 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Creating offline snapshot 2d138f1a-7372-4647-98be-7512d540d76a of volume da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:41:41 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8b200-3a62-4068-b841-c9b086dde74b]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7" returned: 0 in 0.515s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:41 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=109, name=volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:41:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a 1G" returned: 0 in 0.308s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): qemu-img rebase -u -b volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "qemu-img rebase -u -b volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a" returned: 0 in 0.181s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a" returned: 0 in 0.095s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a" returned: 0 in 0.082s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.info" returned: 0 in 0.111s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.info" returned: 0 in 0.086s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.694s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:42 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-e8751fca-70bb-462c-81d6-086e8494882f tempest-SnapshotMetadataTestJSON-1986055043 None] Create snapshot completed successfully Sep 17 18:41:43 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Acquiring lock "cinder-2d138f1a-7372-4647-98be-7512d540d76a-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:43 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "cinder-2d138f1a-7372-4647-98be-7512d540d76a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:43 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Acquiring lock "cinder-quobyte-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:43 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "cinder-quobyte-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:43 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Acquiring lock "cinder-quobyte-2d138f1a-7372-4647-98be-7512d540d76a" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:43 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "cinder-quobyte-2d138f1a-7372-4647-98be-7512d540d76a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Deleting offline snapshot 2d138f1a-7372-4647-98be-7512d540d76a of volume da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:41:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] snapshot_file for this snap is: volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:41:44 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1870d248-db45-4bc3-a231-0b8a2ebc71f1]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a" returned: 0 in 0.384s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:41:44 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b52897-a738-4945-87ab-dd84252a9c01]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7" returned: 0 in 0.396s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a" returned: 0 in 0.227s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7.2d138f1a-7372-4647-98be-7512d540d76a" returned: 0 in 0.090s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "cinder-quobyte-2d138f1a-7372-4647-98be-7512d540d76a" released by "_delete_snapshot" :: held 1.409s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "cinder-quobyte-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7" released by "delete_snapshot" :: held 1.429s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:45 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Created reservations ['8c6df983-f754-4a69-b06b-76ce5f2b3dff', 'ee5156ff-3f8d-4557-83ec-a765d2f21d20', 'cc6bdb2d-c08d-4514-84a0-e858b258733a', '7f30e464-4ae4-4753-8691-d384faf53a72'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:41:45 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Delete snapshot completed successfully. Sep 17 18:41:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b4875a7c-59e9-4345-9cea-766da5b596c4 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "cinder-2d138f1a-7372-4647-98be-7512d540d76a-delete_snapshot" released by "delete_snapshot" :: held 1.866s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Acquiring lock "cinder-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "cinder-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:46 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Acquiring lock "cinder-quobyte-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "cinder-quobyte-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:46 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c31550a-2417-4514-b25d-43d773af7520]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7" returned: 0 in 0.388s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7" returned: 0 in 0.104s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "cinder-quobyte-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7" released by "delete_volume" :: held 0.643s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:47 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Created reservations ['a45728cb-9c73-468c-b8fa-23b0d46905f9', 'a2ef9f24-a564-4f32-84fb-86d4020130f4', 'cf815318-5410-4473-a5d8-a119d491e22c', 'e0de93bf-0555-4daa-869c-323386ad27f7'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:41:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:41:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:41:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.110s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:47 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:41:47 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Deleted volume successfully. Sep 17 18:41:47 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-bf7e8c83-2f22-4cc6-8ed4-85cd6260be43 tempest-SnapshotMetadataTestJSON-1986055043 None] Lock "cinder-da0c1f0e-18b9-40c2-81c4-7d09e2bdb3d7-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:41:50 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Flow 'volume_create_manager' (acae6e2e-7685-4aab-9af2-00ef73b626e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0982524-4ab8-4b20-b962-ebbb4bfb43f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0982524-4ab8-4b20-b962-ebbb4bfb43f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1286152121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506df15a-4f9f-450b-be28-574f2fdeedf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731f95de461948809fc79dfe7d01c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:50Z,use_quota=True,user_id='f0e39ccf10864997970cee144449ab07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5cecc7-8c55-47c1-aaae-f788315f3456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5cecc7-8c55-47c1-aaae-f788315f3456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb1d24f-7690-42a5-b4f7-bd9b73f8f37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb1d24f-7690-42a5-b4f7-bd9b73f8f37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '506df15a-4f9f-450b-be28-574f2fdeedf0', 'volume_name': 'volume-506df15a-4f9f-450b-be28-574f2fdeedf0', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd25301-48f7-4c8d-8a09-ccedb720eda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd25301-48f7-4c8d-8a09-ccedb720eda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b970e3-1d18-4cf0-9e21-d9334d61775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:50 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Volume 506df15a-4f9f-450b-be28-574f2fdeedf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-506df15a-4f9f-450b-be28-574f2fdeedf0', 'volume_size': 1} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1286152121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506df15a-4f9f-450b-be28-574f2fdeedf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731f95de461948809fc79dfe7d01c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:41:50Z,use_quota=True,user_id='f0e39ccf10864997970cee144449ab07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Creating volume 506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:41:50 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:50 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=111, name=volume-506df15a-4f9f-450b-be28-574f2fdeedf0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:41:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 1073741824" returned: 0 in 0.311s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0" returned: 0 in 0.085s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] <== create_volume: return (465ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.476s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b970e3-1d18-4cf0-9e21-d9334d61775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-506df15a-4f9f-450b-be28-574f2fdeedf0', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56674fd-6f38-49fd-b564-bf06d74b2884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:41:51 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Volume volume-506df15a-4f9f-450b-be28-574f2fdeedf0 (506df15a-4f9f-450b-be28-574f2fdeedf0): created successfully Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56674fd-6f38-49fd-b564-bf06d74b2884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Flow 'volume_create_manager' (acae6e2e-7685-4aab-9af2-00ef73b626e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:41:51 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-48c72b5c-e38a-447c-8294-4908fefd129b tempest-VolumesDeleteCascade-770279538 None] Created volume successfully. Sep 17 18:41:51 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Creating offline snapshot 640891ca-8925-4373-be88-96541dcb64c9 of volume 506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0c070a-12b6-4d7c-96a7-ea37dc14291c]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0" returned: 0 in 0.540s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:52 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=112, name=volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:41:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 1G" returned: 0 in 0.331s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img rebase -u -b volume-506df15a-4f9f-450b-be28-574f2fdeedf0 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img rebase -u -b volume-506df15a-4f9f-450b-be28-574f2fdeedf0 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9" returned: 0 in 0.216s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9" returned: 0 in 0.290s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-f7ccf079-8fc2-415f-9a25-1e6be1ed56ce req-343be4fa-00ba-4385-b7f8-4998ab7f0cec tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9" returned: 0 in 0.202s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.info" returned: 0 in 0.113s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:41:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.info" returned: 0 in 0.106s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-f7ccf079-8fc2-415f-9a25-1e6be1ed56ce req-343be4fa-00ba-4385-b7f8-4998ab7f0cec tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.448s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:54 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e92a027-3124-4eb2-ae8f-94be65dd6a5e]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-f7ccf079-8fc2-415f-9a25-1e6be1ed56ce req-343be4fa-00ba-4385-b7f8-4998ab7f0cec tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:54 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-e5ac9465-27a3-4126-8c5e-0e0b1b600a81 tempest-VolumesDeleteCascade-770279538 None] Create snapshot completed successfully Sep 17 18:41:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-f7ccf079-8fc2-415f-9a25-1e6be1ed56ce req-343be4fa-00ba-4385-b7f8-4998ab7f0cec tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3" returned: 0 in 0.473s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-f7ccf079-8fc2-415f-9a25-1e6be1ed56ce req-343be4fa-00ba-4385-b7f8-4998ab7f0cec tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.571s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:54 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-f7ccf079-8fc2-415f-9a25-1e6be1ed56ce req-343be4fa-00ba-4385-b7f8-4998ab7f0cec tempest-TestInstancesWithCinderVolumes-634386560 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc7a143e-efe3-4c64-9848-0c68114911c8', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:41:54 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-f7ccf079-8fc2-415f-9a25-1e6be1ed56ce req-343be4fa-00ba-4385-b7f8-4998ab7f0cec tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:55 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-f7ccf079-8fc2-415f-9a25-1e6be1ed56ce req-343be4fa-00ba-4385-b7f8-4998ab7f0cec tempest-TestInstancesWithCinderVolumes-634386560 None] attachment_update completed successfully. Sep 17 18:41:55 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:41:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:41:55 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Creating offline snapshot 6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 of volume 506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:41:55 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0357ba97-f001-4b0b-b6df-632ab52e7c46]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9" returned: 0 in 0.401s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:55 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-506df15a-4f9f-450b-be28-574f2fdeedf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:41:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:56 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=114, name=volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:41:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 1G" returned: 0 in 0.366s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img rebase -u -b volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img rebase -u -b volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9" returned: 0 in 0.172s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:41:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9" returned: 0 in 0.125s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:41:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9" returned: 0 in 0.104s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.489s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:41:57 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-024b3827-732a-4866-839c-b86f0dc9e840 tempest-VolumesDeleteCascade-770279538 None] Create snapshot completed successfully Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-506df15a-4f9f-450b-be28-574f2fdeedf0-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-506df15a-4f9f-450b-be28-574f2fdeedf0-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:57 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Performing cascade delete. {{(pid=83736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-640891ca-8925-4373-be88-96541dcb64c9-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-640891ca-8925-4373-be88-96541dcb64c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:57 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-quobyte-506df15a-4f9f-450b-be28-574f2fdeedf0" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-506df15a-4f9f-450b-be28-574f2fdeedf0" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-quobyte-640891ca-8925-4373-be88-96541dcb64c9" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-640891ca-8925-4373-be88-96541dcb64c9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Deleting offline snapshot 640891ca-8925-4373-be88-96541dcb64c9 of volume 506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] snapshot_file for this snap is: volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d304f36-6c7f-439a-8f35-059118765e63]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9" returned: 0 in 0.441s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-506df15a-4f9f-450b-be28-574f2fdeedf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:41:58 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f981c0dc-f038-453c-8cd4-28c00e8872d3]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0" returned: 0 in 0.445s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:58 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce2bc16-1e3d-45c6-a57e-06645aad8349]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:59 devstack quobyte-client[83739]: System call of process 97089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:41:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9" returned: 0 in 0.394s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:41:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-506df15a-4f9f-450b-be28-574f2fdeedf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:41:59 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[44275e88-845e-4db6-ae01-7819a1a4bb56]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:41:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:41:59 devstack quobyte-client[83739]: System call of process 97092 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:41:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9" returned: 0 in 0.579s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:00 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-506df15a-4f9f-450b-be28-574f2fdeedf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:42:00 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35949e1-fd35-4789-a486-02d72192f7a1]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:00 devstack quobyte-client[83739]: System call of process 97096 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:42:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0" returned: 0 in 0.534s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9" returned: 0 in 0.262s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.640891ca-8925-4373-be88-96541dcb64c9" returned: 0 in 0.099s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img rebase -u -b volume-506df15a-4f9f-450b-be28-574f2fdeedf0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 -F qcow2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:01 devstack quobyte-client[83739]: System call of process 97107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:42:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img rebase -u -b volume-506df15a-4f9f-450b-be28-574f2fdeedf0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 -F qcow2" returned: 0 in 0.181s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-640891ca-8925-4373-be88-96541dcb64c9" released by "_delete_snapshot" :: held 3.638s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-506df15a-4f9f-450b-be28-574f2fdeedf0" released by "delete_snapshot" :: held 3.681s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:01 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Created reservations ['743182e4-efa0-494e-af68-ed6ca7bc2589', '38319a85-f2e1-42a0-b3f4-40033ba06a58', 'aa0ccc0b-33ce-4f04-909b-41f1233a65d9', 'd335b5f6-2690-48c4-acc0-da619e0783a2'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:42:01 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Delete snapshot completed successfully. Sep 17 18:42:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-640891ca-8925-4373-be88-96541dcb64c9-delete_snapshot" released by "delete_snapshot" :: held 4.186s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:01 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-quobyte-506df15a-4f9f-450b-be28-574f2fdeedf0" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-506df15a-4f9f-450b-be28-574f2fdeedf0" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-quobyte-6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Deleting offline snapshot 6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 of volume 506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] snapshot_file for this snap is: volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7158d8-1145-4cff-97c9-2e6c4950a8e0]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9" returned: 0 in 0.397s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-506df15a-4f9f-450b-be28-574f2fdeedf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc2289d-f0f5-4597-954a-27aa951f2078]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0" returned: 0 in 0.413s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9" returned: 0 in 0.204s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0.6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9" returned: 0 in 0.079s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9" released by "_delete_snapshot" :: held 1.387s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-506df15a-4f9f-450b-be28-574f2fdeedf0" released by "delete_snapshot" :: held 1.406s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Created reservations ['6fbfac6b-b08c-41b6-8a4c-66138b3e193c', '0a5d2ff2-e32a-400a-b771-ebbead7c298c', '87eaa626-30a0-432e-9b5d-bd822a5f04b2', '59313d6d-b20b-472a-8a6a-f0a0b925f400'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:42:03 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Delete snapshot completed successfully. Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-6e05cf6c-c594-4217-8fb9-3cc3dce9e4b9-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Snapshots deleted, issuing volume delete {{(pid=83736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-quobyte-506df15a-4f9f-450b-be28-574f2fdeedf0" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-506df15a-4f9f-450b-be28-574f2fdeedf0" acquired by "delete_volume" :: waited 0.014s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[783e03d8-629f-4df1-9b3b-0888058c557b]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0" returned: 0 in 0.382s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-506df15a-4f9f-450b-be28-574f2fdeedf0" returned: 0 in 0.101s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:04 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-506df15a-4f9f-450b-be28-574f2fdeedf0" released by "delete_volume" :: held 0.666s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:04 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Created reservations ['80589042-b9d2-4e5c-be2b-cf88c4dd1b88', 'e13d113f-f142-4ad3-a75b-672393bb5158', 'efaecdf1-8cf9-4e6d-b2ff-575579ba8287', '6e90083f-951d-4f2e-bf44-abf93d58354d'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:42:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:42:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:42:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.080s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:05 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:42:05 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Deleted volume successfully. Sep 17 18:42:05 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-53636277-3550-4dd9-b7bd-bbee46ef50dd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-506df15a-4f9f-450b-be28-574f2fdeedf0-delete_volume" released by "delete_volume" :: held 7.756s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:06 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Flow 'volume_create_manager' (6cb2c699-35a3-46aa-bc8e-48716d18c77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4dbe4dd-728e-4eac-978b-36cbf2c15d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4dbe4dd-728e-4eac-978b-36cbf2c15d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-629993269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185b7443-3fd0-4d75-a391-9770a025bbb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731f95de461948809fc79dfe7d01c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:42:06Z,use_quota=True,user_id='f0e39ccf10864997970cee144449ab07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064cf823-6011-436c-b553-e8bb42653b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064cf823-6011-436c-b553-e8bb42653b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06efe9d2-9077-466b-a148-c3af2bb93e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06efe9d2-9077-466b-a148-c3af2bb93e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185b7443-3fd0-4d75-a391-9770a025bbb6', 'volume_name': 'volume-185b7443-3fd0-4d75-a391-9770a025bbb6', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48dffa6-8543-4ab7-a26c-19613f5f9aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48dffa6-8543-4ab7-a26c-19613f5f9aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b84e32-89e6-4615-96e6-bff4905a2a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:06 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Volume 185b7443-3fd0-4d75-a391-9770a025bbb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185b7443-3fd0-4d75-a391-9770a025bbb6', 'volume_size': 1} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-629993269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185b7443-3fd0-4d75-a391-9770a025bbb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731f95de461948809fc79dfe7d01c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:42:06Z,use_quota=True,user_id='f0e39ccf10864997970cee144449ab07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Creating volume 185b7443-3fd0-4d75-a391-9770a025bbb6 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:42:06 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:06 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=115, name=volume-185b7443-3fd0-4d75-a391-9770a025bbb6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-d570b79f-2bba-4062-b748-9880948b275c req-0068a420-9ccc-4bd6-865c-128e535bdd6e tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 1073741824" returned: 0 in 0.353s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6" returned: 0 in 0.132s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] <== create_volume: return (521ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:42:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.530s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-d570b79f-2bba-4062-b748-9880948b275c req-0068a420-9ccc-4bd6-865c-128e535bdd6e tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.348s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:07 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[182fc018-2068-499b-a50b-1d8e4ad4759f]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-d570b79f-2bba-4062-b748-9880948b275c req-0068a420-9ccc-4bd6-865c-128e535bdd6e tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f67566ba-0501-4368-a769-d05269c1db17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b84e32-89e6-4615-96e6-bff4905a2a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185b7443-3fd0-4d75-a391-9770a025bbb6', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e385b714-3c36-4f43-886c-698c6af25ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:07 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Volume volume-185b7443-3fd0-4d75-a391-9770a025bbb6 (185b7443-3fd0-4d75-a391-9770a025bbb6): created successfully Sep 17 18:42:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e385b714-3c36-4f43-886c-698c6af25ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Flow 'volume_create_manager' (6cb2c699-35a3-46aa-bc8e-48716d18c77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:42:07 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7d79f7c5-b346-4ac0-96a9-46fe30dd9b52 tempest-VolumesDeleteCascade-770279538 None] Created volume successfully. Sep 17 18:42:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-d570b79f-2bba-4062-b748-9880948b275c req-0068a420-9ccc-4bd6-865c-128e535bdd6e tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f67566ba-0501-4368-a769-d05269c1db17" returned: 0 in 0.557s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-d570b79f-2bba-4062-b748-9880948b275c req-0068a420-9ccc-4bd6-865c-128e535bdd6e tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.613s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-d570b79f-2bba-4062-b748-9880948b275c req-0068a420-9ccc-4bd6-865c-128e535bdd6e tempest-TestInstancesWithCinderVolumes-634386560 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-f67566ba-0501-4368-a769-d05269c1db17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe6e2d7d-9cbc-4bf2-a0b9-b12e9024a0bb', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:42:07 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-d570b79f-2bba-4062-b748-9880948b275c req-0068a420-9ccc-4bd6-865c-128e535bdd6e tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:07 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-d570b79f-2bba-4062-b748-9880948b275c req-0068a420-9ccc-4bd6-865c-128e535bdd6e tempest-TestInstancesWithCinderVolumes-634386560 None] attachment_update completed successfully. Sep 17 18:42:08 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:08 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Creating offline snapshot bd924d37-2e64-4736-91bc-ac28c3c787d3 of volume 185b7443-3fd0-4d75-a391-9770a025bbb6 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:42:08 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[382be4c3-c273-4d61-bc4a-174b6b2f9787]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6" returned: 0 in 0.474s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:09 devstack quobyte-client[83739]: System call of process 97151 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:42:09 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=116, name=volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3 1G" returned: 0 in 0.290s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img rebase -u -b volume-185b7443-3fd0-4d75-a391-9770a025bbb6 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img rebase -u -b volume-185b7443-3fd0-4d75-a391-9770a025bbb6 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3" returned: 0 in 0.199s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3" returned: 0 in 0.115s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3" returned: 0 in 0.114s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.info" returned: 0 in 0.185s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:42:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.info" returned: 0 in 0.079s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.774s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:10 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-9c611b50-67ba-466c-b048-1abae630f63a tempest-VolumesDeleteCascade-770279538 None] Create snapshot completed successfully Sep 17 18:42:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Flow 'volume_create_manager' (1a714f6c-3153-45df-ab7b-a0dbfce5185f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cff6ef1-d04e-488b-af55-96a0887aec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cff6ef1-d04e-488b-af55-96a0887aec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-703488696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd8c857-247c-440f-ac83-10f1ba96e69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731f95de461948809fc79dfe7d01c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bd924d37-2e64-4736-91bc-ac28c3c787d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:42:12Z,use_quota=True,user_id='f0e39ccf10864997970cee144449ab07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52cb1f1-da25-4356-87ad-564446b96b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52cb1f1-da25-4356-87ad-564446b96b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baead4eb-5c16-4c2b-9809-b46eacf674df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baead4eb-5c16-4c2b-9809-b46eacf674df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cdd8c857-247c-440f-ac83-10f1ba96e69d', 'volume_name': 'volume-cdd8c857-247c-440f-ac83-10f1ba96e69d', 'volume_size': 1, 'snapshot_id': 'bd924d37-2e64-4736-91bc-ac28c3c787d3'}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57aeb6b1-48ef-4b35-92dc-77a781f84165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57aeb6b1-48ef-4b35-92dc-77a781f84165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c6be83-32ad-4c3d-b876-786999cd1735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:12 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Volume cdd8c857-247c-440f-ac83-10f1ba96e69d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cdd8c857-247c-440f-ac83-10f1ba96e69d', 'volume_size': 1, 'snapshot_id': 'bd924d37-2e64-4736-91bc-ac28c3c787d3'} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-quobyte-bd924d37-2e64-4736-91bc-ac28c3c787d3-cdd8c857-247c-440f-ac83-10f1ba96e69d" by "_create_volume_from_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-bd924d37-2e64-4736-91bc-ac28c3c787d3-cdd8c857-247c-440f-ac83-10f1ba96e69d" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Creating volume cdd8c857-247c-440f-ac83-10f1ba96e69d from snapshot bd924d37-2e64-4736-91bc-ac28c3c787d3 {{(pid=83736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-quobyte-cdd8c857-247c-440f-ac83-10f1ba96e69d" by "_copy_volume_from_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-cdd8c857-247c-440f-ac83-10f1ba96e69d" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] snapshot: bd924d37-2e64-4736-91bc-ac28c3c787d3, volume: cdd8c857-247c-440f-ac83-10f1ba96e69d, {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[852f761f-dcfa-4681-b79e-5ae8c2ae8af2]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3" returned: 0 in 0.401s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-185b7443-3fd0-4d75-a391-9770a025bbb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:42:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 17 18:42:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Creating direct copy from snapshot {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 17 18:42:13 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7b2d10-f14b-4d7c-908f-529a55e0d046]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:13 devstack quobyte-client[83739]: System call of process 97167 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:42:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6" returned: 0 in 0.465s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:13 devstack cinder-volume[83736]: DEBUG cinder.utils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cdd8c857-247c-440f-ac83-10f1ba96e69d not found in is_blk_device check {{(pid=83736) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 17 18:42:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cdd8c857-247c-440f-ac83-10f1ba96e69d {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:13 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=118, name=volume-cdd8c857-247c-440f-ac83-10f1ba96e69d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:42:17 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:42:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:42:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:42:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.114s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.674s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:18 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:42:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cdd8c857-247c-440f-ac83-10f1ba96e69d" returned: 0 in 7.664s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:21 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eac055-aeb1-4e55-a1b6-b651762a4045]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6" returned: 0 in 0.662s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cdd8c857-247c-440f-ac83-10f1ba96e69d {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:42:22 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Converted 1024.00 MB image at 133.34 MB/s Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cdd8c857-247c-440f-ac83-10f1ba96e69d is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cdd8c857-247c-440f-ac83-10f1ba96e69d {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cdd8c857-247c-440f-ac83-10f1ba96e69d" returned: 0 in 0.087s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-cdd8c857-247c-440f-ac83-10f1ba96e69d" released by "_copy_volume_from_snapshot" :: held 9.634s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-bd924d37-2e64-4736-91bc-ac28c3c787d3-cdd8c857-247c-440f-ac83-10f1ba96e69d" released by "_create_volume_from_snapshot" :: held 9.669s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.688s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c6be83-32ad-4c3d-b876-786999cd1735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd8c857-247c-440f-ac83-10f1ba96e69d', 'volume_size': 1, 'snapshot_id': 'bd924d37-2e64-4736-91bc-ac28c3c787d3'}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbca7ae-7e99-44dc-9fa1-ed3623da45c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:22 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Volume volume-cdd8c857-247c-440f-ac83-10f1ba96e69d (cdd8c857-247c-440f-ac83-10f1ba96e69d): created successfully Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbca7ae-7e99-44dc-9fa1-ed3623da45c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Flow 'volume_create_manager' (1a714f6c-3153-45df-ab7b-a0dbfce5185f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:42:22 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ba607bda-a1b0-4088-ace4-eaeba7329ce9 tempest-VolumesDeleteCascade-770279538 None] Created volume successfully. Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-185b7443-3fd0-4d75-a391-9770a025bbb6-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-185b7443-3fd0-4d75-a391-9770a025bbb6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:23 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Performing cascade delete. {{(pid=83736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-bd924d37-2e64-4736-91bc-ac28c3c787d3-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-bd924d37-2e64-4736-91bc-ac28c3c787d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:23 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-quobyte-185b7443-3fd0-4d75-a391-9770a025bbb6" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-185b7443-3fd0-4d75-a391-9770a025bbb6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-quobyte-bd924d37-2e64-4736-91bc-ac28c3c787d3" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-bd924d37-2e64-4736-91bc-ac28c3c787d3" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Deleting offline snapshot bd924d37-2e64-4736-91bc-ac28c3c787d3 of volume 185b7443-3fd0-4d75-a391-9770a025bbb6 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] snapshot_file for this snap is: volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad2e5bd-28fa-4c70-a03d-e1424d43a3ca]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:23 devstack quobyte-client[83739]: System call of process 97259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3" returned: 0 in 0.450s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-185b7443-3fd0-4d75-a391-9770a025bbb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f761f1b1-ebdb-49c6-b3ed-a009dfa12800]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6" returned: 0 in 0.386s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3" returned: 0 in 0.172s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6.bd924d37-2e64-4736-91bc-ac28c3c787d3" returned: 0 in 0.089s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-bd924d37-2e64-4736-91bc-ac28c3c787d3" released by "_delete_snapshot" :: held 1.396s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-185b7443-3fd0-4d75-a391-9770a025bbb6" released by "delete_snapshot" :: held 1.442s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:24 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Created reservations ['a5c1c6c3-a3ae-4fd9-b816-b5d0841ffaa1', '58c57131-11e8-4a7a-a079-60e0addf3c93', 'e586563c-1afb-4c22-9e8f-66d605f64d55', 'aeea4222-2c08-48e5-b7c7-93d58af5a0c1'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:42:25 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Delete snapshot completed successfully. Sep 17 18:42:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-bd924d37-2e64-4736-91bc-ac28c3c787d3-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Snapshots deleted, issuing volume delete {{(pid=83736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 18:42:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-quobyte-185b7443-3fd0-4d75-a391-9770a025bbb6" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-185b7443-3fd0-4d75-a391-9770a025bbb6" acquired by "delete_volume" :: waited 0.027s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:25 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[34334f09-d44d-48b0-b123-0c5c1505d631]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6" returned: 0 in 0.397s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-185b7443-3fd0-4d75-a391-9770a025bbb6" returned: 0 in 0.086s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-185b7443-3fd0-4d75-a391-9770a025bbb6" released by "delete_volume" :: held 0.646s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:25 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Created reservations ['c29c0a3a-a6e1-44d5-bf59-86836eb18cb0', '2f705385-823e-416e-a9c0-011e39fd198b', 'da94a7a9-fcd3-48d9-9a96-63aff2ab2200', '31601283-13f7-4ad1-95f6-378ee2ac2094'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.094s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:42:26 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Deleted volume successfully. Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-cdd8c857-247c-440f-ac83-10f1ba96e69d-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-cdd8c857-247c-440f-ac83-10f1ba96e69d-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-8d051587-a0e7-4f12-96db-4d322fef02ef tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-185b7443-3fd0-4d75-a391-9770a025bbb6-delete_volume" released by "delete_volume" :: held 3.691s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:26 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "cinder-quobyte-cdd8c857-247c-440f-ac83-10f1ba96e69d" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-cdd8c857-247c-440f-ac83-10f1ba96e69d" acquired by "delete_volume" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d59d6dc-80a6-496f-84ca-0ccb9b3867e0]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cdd8c857-247c-440f-ac83-10f1ba96e69d {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cdd8c857-247c-440f-ac83-10f1ba96e69d" returned: 0 in 0.389s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cdd8c857-247c-440f-ac83-10f1ba96e69d {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cdd8c857-247c-440f-ac83-10f1ba96e69d" returned: 0 in 0.111s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-quobyte-cdd8c857-247c-440f-ac83-10f1ba96e69d" released by "delete_volume" :: held 0.659s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:27 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Created reservations ['2c68637f-4b6b-4dc7-9ba1-8d6fc33337a0', '1ad86ee5-ddd7-4d0b-bfcb-00a7dd00c680', '6cde7f70-dc60-43ea-8c8f-bbd9ab513cd2', '2d534a37-91bb-49c7-aac4-29b944e9554f'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:42:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:42:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:42:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.088s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:28 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:42:28 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Deleted volume successfully. Sep 17 18:42:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-523e7931-db85-4ab0-999d-43dd030c99fd tempest-VolumesDeleteCascade-770279538 None] Lock "cinder-cdd8c857-247c-440f-ac83-10f1ba96e69d-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=68,cinder:UPDATE=62,cinder:DELETE=7,cinder:INSERT=14 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=59,cinder:UPDATE=77,cinder:INSERT=18,cinder:DELETE=5 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:42:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Flow 'volume_create_manager' (69654356-660b-44ce-a483-66d2ea643fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0926aff7-bc3f-4bb9-966d-467eb5a2a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0926aff7-bc3f-4bb9-966d-467eb5a2a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1723721219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd679ee8-8f35-4de8-b59d-d60f087f5ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455bc0fdff1f452caca0be1a9330ec78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:42:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:42:33Z,use_quota=True,user_id='07063ae8c9ba427593bfb09404797b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a90b9c-125f-4535-bc09-6664670da8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a90b9c-125f-4535-bc09-6664670da8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097f30bd-9097-4afc-abe9-d3af4a984115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097f30bd-9097-4afc-abe9-d3af4a984115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd679ee8-8f35-4de8-b59d-d60f087f5ba6', 'volume_name': 'volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6', 'volume_size': 2}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c558753e-3373-4e80-af04-b7a5cdff3538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c558753e-3373-4e80-af04-b7a5cdff3538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacceeea-09fa-4b2e-8e8c-43f69c61e52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:33 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Volume cd679ee8-8f35-4de8-b59d-d60f087f5ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6', 'volume_size': 2} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1723721219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd679ee8-8f35-4de8-b59d-d60f087f5ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455bc0fdff1f452caca0be1a9330ec78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:42:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:42:33Z,use_quota=True,user_id='07063ae8c9ba427593bfb09404797b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Creating volume cd679ee8-8f35-4de8-b59d-d60f087f5ba6 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:42:33 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:42:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6 2147483648 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:34 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=119, name=volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:42:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6 2147483648" returned: 0 in 0.446s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6" returned: 0 in 0.096s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] <== create_volume: return (607ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:42:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.620s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacceeea-09fa-4b2e-8e8c-43f69c61e52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6', 'volume_size': 2}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8948a970-8c3c-4351-875d-14ad77971eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:42:34 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Volume volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6 (cd679ee8-8f35-4de8-b59d-d60f087f5ba6): created successfully Sep 17 18:42:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8948a970-8c3c-4351-875d-14ad77971eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:42:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Flow 'volume_create_manager' (69654356-660b-44ce-a483-66d2ea643fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:42:34 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4b1e930c-f91c-46b8-9670-bed51193cc53 tempest-VolumesCloneNegativeTest-1030374952 None] Created volume successfully. Sep 17 18:42:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Acquiring lock "cinder-cd679ee8-8f35-4de8-b59d-d60f087f5ba6-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Lock "cinder-cd679ee8-8f35-4de8-b59d-d60f087f5ba6-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:36 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Acquiring lock "cinder-quobyte-cd679ee8-8f35-4de8-b59d-d60f087f5ba6" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Lock "cinder-quobyte-cd679ee8-8f35-4de8-b59d-d60f087f5ba6" acquired by "delete_volume" :: waited 0.009s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:36 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[51277da6-e459-4ee1-aa47-1359cea37fe0]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6" returned: 0 in 0.406s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cd679ee8-8f35-4de8-b59d-d60f087f5ba6" returned: 0 in 0.113s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Lock "cinder-quobyte-cd679ee8-8f35-4de8-b59d-d60f087f5ba6" released by "delete_volume" :: held 0.661s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:36 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Created reservations ['11797e45-e1f2-413e-a7a3-184fd2b62d39', '9418159c-61a4-44e4-b322-8b7bde86f4ec', '75590008-a13b-4ad0-969d-9ac5b4f6377e', 'ed3723fd-1a4c-40c1-9f49-2ecc61498321'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:42:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:42:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:42:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.099s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:37 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:42:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Deleted volume successfully. Sep 17 18:42:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fc17d2dd-307f-46cd-bc17-0a7d6cfa584d tempest-VolumesCloneNegativeTest-1030374952 None] Lock "cinder-cd679ee8-8f35-4de8-b59d-d60f087f5ba6-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-964a05ce-19aa-4828-bd2d-560618d44324 req-c74aa05b-489e-42e4-9d67-b1bfeaf069f7 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-964a05ce-19aa-4828-bd2d-560618d44324 req-c74aa05b-489e-42e4-9d67-b1bfeaf069f7 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:43 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-964a05ce-19aa-4828-bd2d-560618d44324 req-c74aa05b-489e-42e4-9d67-b1bfeaf069f7 tempest-TestInstancesWithCinderVolumes-634386560 None] Terminate volume connection completed successfully. Sep 17 18:42:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-964a05ce-19aa-4828-bd2d-560618d44324 req-c74aa05b-489e-42e4-9d67-b1bfeaf069f7 tempest-TestInstancesWithCinderVolumes-634386560 None] Deleting attachment cc7a143e-efe3-4c64-9848-0c68114911c8. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:42:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "cinder-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:45 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:42:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "cinder-quobyte-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:42:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-quobyte-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3" acquired by "delete_volume" :: waited 0.017s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:42:45 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe04838-7a46-4009-ae3c-d0319c27b4f8]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:42:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:45 devstack quobyte-client[83739]: System call of process 97328 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:42:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3" returned: 0 in 0.539s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3" returned: 0 in 0.156s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-quobyte-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3" released by "delete_volume" :: held 0.898s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:46 devstack cinder-volume[83736]: WARNING cinder.quota [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1542087729-1606040334 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1542087729-1606040334, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:42:46 devstack cinder-volume[83736]: WARNING cinder.quota [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1542087729-1606040334 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1542087729-1606040334, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:42:46 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Created reservations ['4b388a32-6c88-4ecc-b856-f7d442cb6a4a', '1f3050e1-b3ba-4e7d-bed1-7f7618f57518', '729dad87-eb5e-4046-924c-5f5ba515d566', '62328959-c67e-40ae-8fef-280a60cd5ff5'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:42:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:42:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:42:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:42:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:42:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:42:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:42:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.122s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:42:47 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:42:47 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Deleted volume successfully. Sep 17 18:42:47 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ae884880-ea90-4a3e-b14a-53e030f8cefc tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-342f9c4a-5bb3-490a-9e1c-a3a13e010ea3-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:42:56 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=22,cinder:SELECT=13,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:42:57 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:43:08 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Flow 'volume_create_manager' (064ba51e-4e28-4d3b-84e7-024e464a2ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e696b0-b886-4723-b7af-deed7e724840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e696b0-b886-4723-b7af-deed7e724840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-465863828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499b291a-fa0d-4d41-8690-83916252c235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45afd732f1d445b9ae73a999eb971b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:43:08Z,use_quota=True,user_id='9c891c157cf44c169b3433298d527d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd40994-25c5-4f9b-9458-745073b5d862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd40994-25c5-4f9b-9458-745073b5d862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0b1766-f2ba-4f14-aff4-b6ec9392e1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.image.glance [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Creating Keystone auth plugin from conf {{(pid=83736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0b1766-f2ba-4f14-aff4-b6ec9392e1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '499b291a-fa0d-4d41-8690-83916252c235', 'volume_name': 'volume-499b291a-fa0d-4d41-8690-83916252c235', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60cdef0b-9f70-4f16-bccc-28431fef27ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60cdef0b-9f70-4f16-bccc-28431fef27ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada0d0ac-94de-4f3c-929a-466c9b01de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:43:08 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Volume 499b291a-fa0d-4d41-8690-83916252c235: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-499b291a-fa0d-4d41-8690-83916252c235', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 18:43:08 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Cloning 499b291a-fa0d-4d41-8690-83916252c235 from image 9006947d-67cc-459e-820f-320733203bdb at location (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]). {{(pid=83736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 17 18:43:09 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 18:43:09 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Image download 20.69 MB at 20.69 MB/s Sep 17 18:43:09 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fa3e28-0ee7-4e40-bf91-be0341c47e33]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:43:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:09 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD Sep 17 18:43:09 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:43:11 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Sep 17 18:43:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD" returned: 0 in 1.993s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:11 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Temporary image 9006947d-67cc-459e-820f-320733203bdb is fetched for user 9c891c157cf44c169b3433298d527d3f. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 18:43:11 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0b8bd5-6f3f-4ed4-8cc9-d6bfc37c188b]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:43:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:11 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD Sep 17 18:43:11 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:43:13 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD" returned: 0 in 1.865s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-465863828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499b291a-fa0d-4d41-8690-83916252c235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45afd732f1d445b9ae73a999eb971b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:43:08Z,use_quota=True,user_id='9c891c157cf44c169b3433298d527d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Creating volume 499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:43:13 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:13 devstack quobyte-client[83739]: System call of process 97376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:43:13 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=120, name=volume-499b291a-fa0d-4d41-8690-83916252c235, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 1073741824" returned: 0 in 0.311s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235" returned: 0 in 0.093s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] <== create_volume: return (503ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.536s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:43:13 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Attempting download of 9006947d-67cc-459e-820f-320733203bdb ((None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}])) to volume 499b291a-fa0d-4d41-8690-83916252c235. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 18:43:14 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[29774794-e3f6-424e-836c-34b6d4200d07]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:43:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_psae3mha {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_psae3mha" returned: 0 in 0.378s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_psae3mha {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:14 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-46460d79-b287-44d6-9280-0fa539610e04 req-102273e3-b8fc-475f-8926-de885f11aaa0 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:43:15 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-46460d79-b287-44d6-9280-0fa539610e04 req-102273e3-b8fc-475f-8926-de885f11aaa0 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:43:15 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-46460d79-b287-44d6-9280-0fa539610e04 req-102273e3-b8fc-475f-8926-de885f11aaa0 tempest-TestInstancesWithCinderVolumes-634386560 None] Terminate volume connection completed successfully. Sep 17 18:43:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-46460d79-b287-44d6-9280-0fa539610e04 req-102273e3-b8fc-475f-8926-de885f11aaa0 tempest-TestInstancesWithCinderVolumes-634386560 None] Deleting attachment fe6e2d7d-9cbc-4bf2-a0b9-b12e9024a0bb. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:43:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_psae3mha" returned: 1 in 0.533s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9006947d-67cc-459e-820f-320733203bdb_psae3mha' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:43:15 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57e2cf3-35d9-4752-971a-738ae00ac078]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:43:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:15 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] 9006947d-67cc-459e-820f-320733203bdb was qcow2, converting to raw {{(pid=83736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 18:43:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:15 devstack quobyte-client[83739]: System call of process 97389 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:43:15 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=120, name=volume-499b291a-fa0d-4d41-8690-83916252c235, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:43:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "cinder-f67566ba-0501-4368-a769-d05269c1db17-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:43:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-f67566ba-0501-4368-a769-d05269c1db17-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:43:17 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:43:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:43:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:43:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:43:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:43:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:43:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235" returned: 0 in 2.248s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:17 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9006947d-67cc-459e-820f-320733203bdb_x8t4f29adevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:43:17 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Converted 112.00 MB image at 49.46 MB/s Sep 17 18:43:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:18 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:43:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "cinder-quobyte-f67566ba-0501-4368-a769-d05269c1db17" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:43:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 1.070s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:18 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:43:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 1G" returned: 0 in 0.428s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-quobyte-f67566ba-0501-4368-a769-d05269c1db17" acquired by "delete_volume" :: waited 0.214s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:43:18 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f892ee-265a-4faa-8589-fb4bf8768dec]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:43:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f67566ba-0501-4368-a769-d05269c1db17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:18 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f7e633-a09d-4b76-b896-a074061dcadd]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:43:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:19 devstack quobyte-client[83739]: System call of process 97433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:43:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f67566ba-0501-4368-a769-d05269c1db17" returned: 0 in 0.815s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f67566ba-0501-4368-a769-d05269c1db17 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f67566ba-0501-4368-a769-d05269c1db17" returned: 0 in 0.159s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-quobyte-f67566ba-0501-4368-a769-d05269c1db17" released by "delete_volume" :: held 1.230s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:43:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235" returned: 0 in 1.232s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:20 devstack cinder-volume[83736]: WARNING cinder.quota [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1092953718-2057938379 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1092953718-2057938379, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:43:20 devstack cinder-volume[83736]: WARNING cinder.quota [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1092953718-2057938379 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1092953718-2057938379, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Created reservations ['543531da-c85c-4861-8868-040eef5b7b07', '380d4c0a-ba76-45f5-bb8d-73d16aea2de6', '3891cbc1-4f10-4ff2-814c-21139d1ac33a', 'a21c9a30-56cf-46d0-b986-6472b38106bb'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:43:20 devstack quobyte-client[83739]: System call of process 97439 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235" returned: 1 in 0.818s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Downloaded image 9006947d-67cc-459e-820f-320733203bdb ((None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}])) to volume 499b291a-fa0d-4d41-8690-83916252c235 successfully. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Temporary image 9006947d-67cc-459e-820f-320733203bdb for user 9c891c157cf44c169b3433298d527d3f is deleted. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Marking volume 499b291a-fa0d-4d41-8690-83916252c235 as bootable. {{(pid=83736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Copying metadata from image 9006947d-67cc-459e-820f-320733203bdb to 499b291a-fa0d-4d41-8690-83916252c235. {{(pid=83736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Creating volume glance metadata for volume 499b291a-fa0d-4d41-8690-83916252c235 backed by image 9006947d-67cc-459e-820f-320733203bdb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:43:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:21 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada0d0ac-94de-4f3c-929a-466c9b01de1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499b291a-fa0d-4d41-8690-83916252c235', 'volume_size': 1, 'image_id': '9006947d-67cc-459e-820f-320733203bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9006947d-67cc-459e-820f-320733203bdb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53bb39e71d07460ea71ceb6b85c574e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9006947d-67cc-459e-820f-320733203bdb', 'created_at': datetime.datetime(2025, 9, 17, 16, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9006947d-67cc-459e-820f-320733203bdb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:43:21 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514d5984-ccb8-487e-a9b6-68df89bbde66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:43:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.707s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:21 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:43:21 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Deleted volume successfully. Sep 17 18:43:21 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Volume volume-499b291a-fa0d-4d41-8690-83916252c235 (499b291a-fa0d-4d41-8690-83916252c235): created successfully Sep 17 18:43:21 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514d5984-ccb8-487e-a9b6-68df89bbde66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:43:21 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Flow 'volume_create_manager' (064ba51e-4e28-4d3b-84e7-024e464a2ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:43:22 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7e054f81-43b2-4511-8c60-4b6bb841cd9d tempest-TestShelveInstance-2016185709 None] Created volume successfully. Sep 17 18:43:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-166ac4f1-98dd-42e1-90e2-4d1194f80928 tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-f67566ba-0501-4368-a769-d05269c1db17-delete_volume" released by "delete_volume" :: held 5.388s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:43:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-26dea311-acd1-4e4c-b585-a86ab8aa1ac5 req-4612e480-be9d-4247-a6d6-031429daecf1 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:43:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-26dea311-acd1-4e4c-b585-a86ab8aa1ac5 req-4612e480-be9d-4247-a6d6-031429daecf1 tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:43:28 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-26dea311-acd1-4e4c-b585-a86ab8aa1ac5 req-4612e480-be9d-4247-a6d6-031429daecf1 tempest-TestInstancesWithCinderVolumes-634386560 None] Terminate volume connection completed successfully. Sep 17 18:43:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-26dea311-acd1-4e4c-b585-a86ab8aa1ac5 req-4612e480-be9d-4247-a6d6-031429daecf1 tempest-TestInstancesWithCinderVolumes-634386560 None] Deleting attachment d865a881-58b7-44f7-9670-435ab78a93c0. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:43:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-b4c99850-64e8-4fd8-bbdf-d36b8ef51650 req-5ccac8ac-7bd8-4a6e-a0af-83d816f3b9b4 tempest-TestShelveInstance-2016185709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:43:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-b4c99850-64e8-4fd8-bbdf-d36b8ef51650 req-5ccac8ac-7bd8-4a6e-a0af-83d816f3b9b4 tempest-TestShelveInstance-2016185709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:43:33 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5781f6d7-0c4c-4097-8dd1-8c0d045a8546]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:43:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-b4c99850-64e8-4fd8-bbdf-d36b8ef51650 req-5ccac8ac-7bd8-4a6e-a0af-83d816f3b9b4 tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-b4c99850-64e8-4fd8-bbdf-d36b8ef51650 req-5ccac8ac-7bd8-4a6e-a0af-83d816f3b9b4 tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235" returned: 0 in 0.393s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-b4c99850-64e8-4fd8-bbdf-d36b8ef51650 req-5ccac8ac-7bd8-4a6e-a0af-83d816f3b9b4 tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:34 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "cinder-30e63ebd-ceaa-4b7f-975a-9b881c543586-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:43:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-b4c99850-64e8-4fd8-bbdf-d36b8ef51650 req-5ccac8ac-7bd8-4a6e-a0af-83d816f3b9b4 tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235" returned: 1 in 0.621s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-b4c99850-64e8-4fd8-bbdf-d36b8ef51650 req-5ccac8ac-7bd8-4a6e-a0af-83d816f3b9b4 tempest-TestShelveInstance-2016185709 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:43:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-b4c99850-64e8-4fd8-bbdf-d36b8ef51650 req-5ccac8ac-7bd8-4a6e-a0af-83d816f3b9b4 tempest-TestShelveInstance-2016185709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.141s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:43:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-30e63ebd-ceaa-4b7f-975a-9b881c543586-delete_volume" acquired by "delete_volume" :: waited 0.279s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:43:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-b4c99850-64e8-4fd8-bbdf-d36b8ef51650 req-5ccac8ac-7bd8-4a6e-a0af-83d816f3b9b4 tempest-TestShelveInstance-2016185709 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-499b291a-fa0d-4d41-8690-83916252c235', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3934cae4-8393-49f1-8886-8f568109b149', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:43:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-b4c99850-64e8-4fd8-bbdf-d36b8ef51650 req-5ccac8ac-7bd8-4a6e-a0af-83d816f3b9b4 tempest-TestShelveInstance-2016185709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:43:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:43:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "cinder-quobyte-30e63ebd-ceaa-4b7f-975a-9b881c543586" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:43:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-quobyte-30e63ebd-ceaa-4b7f-975a-9b881c543586" acquired by "delete_volume" :: waited 0.022s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:43:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-b4c99850-64e8-4fd8-bbdf-d36b8ef51650 req-5ccac8ac-7bd8-4a6e-a0af-83d816f3b9b4 tempest-TestShelveInstance-2016185709 None] attachment_update completed successfully. Sep 17 18:43:35 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec47751-d0fd-4511-9b50-4ee9698e4335]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:43:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:35 devstack quobyte-client[83739]: System call of process 97547 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:43:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586" returned: 0 in 0.439s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586" returned: 1 in 0.480s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:43:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-30e63ebd-ceaa-4b7f-975a-9b881c543586" returned: 0 in 0.097s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-quobyte-30e63ebd-ceaa-4b7f-975a-9b881c543586" released by "delete_volume" :: held 1.332s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:43:36 devstack cinder-volume[83736]: WARNING cinder.quota [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-344899358-1548749565 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-344899358-1548749565, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:43:36 devstack cinder-volume[83736]: WARNING cinder.quota [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-344899358-1548749565 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-344899358-1548749565, it is now deprecated. Please use the default quota class for default quota. Sep 17 18:43:37 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Created reservations ['da41b4d0-17ac-41c5-8687-242f920a9cd5', '74b161d9-f366-4c2f-b836-19bf958d8f45', '1b9969a4-6101-4e7b-a2d8-ad382e35da2d', 'b5591440-9dd3-4a0d-94cf-cf522abe7986'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:43:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:43:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:43:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:43:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:43:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:43:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:43:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.085s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:43:37 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:43:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Deleted volume successfully. Sep 17 18:43:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-9a75a076-8360-46c4-9d44-b5e6930e230c tempest-TestInstancesWithCinderVolumes-634386560 None] Lock "cinder-30e63ebd-ceaa-4b7f-975a-9b881c543586-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:43:47 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=29,cinder:UPDATE=24,cinder:INSERT=12,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:43:47 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=24,cinder:UPDATE=19,cinder:INSERT=9,cinder:DELETE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:44:17 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:44:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:44:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:44:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:44:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:44:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:44:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:44:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.130s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:44:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:44:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Flow 'volume_create_manager' (10950748-97f1-46c9-951a-3751b1592cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa66a42e-fc85-4db4-b6c4-f372afaa1463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa66a42e-fc85-4db4-b6c4-f372afaa1463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1063452854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ffaa212ef6495890a23989ee777fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:44:28Z,use_quota=True,user_id='2a1250f2dfbd4029aedff6c4ce97a45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec8dd80-b562-4f5e-9b63-64524da9061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec8dd80-b562-4f5e-9b63-64524da9061c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7b783a-4e81-4d93-991b-50d80ef52a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7b783a-4e81-4d93-991b-50d80ef52a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da', 'volume_name': 'volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18454b3-36c0-4668-80a5-5e5b12e2431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18454b3-36c0-4668-80a5-5e5b12e2431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73dd029-c400-4232-b00c-4822dd77a1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:28 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume 040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da', 'volume_size': 1} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1063452854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ffaa212ef6495890a23989ee777fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:44:28Z,use_quota=True,user_id='2a1250f2dfbd4029aedff6c4ce97a45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Creating volume 040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:44:28 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:44:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:44:28 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=121, name=volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da 1073741824" returned: 0 in 0.706s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:44:29 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Flow 'volume_create_manager' (06a3cd8f-8fb7-4818-b4f5-1bb6ac852c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb7961f-72ff-47c5-9bc8-e29d5f7a4d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb7961f-72ff-47c5-9bc8-e29d5f7a4d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1716106981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1144bb9e-8420-4848-b1de-c971b79df860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ffaa212ef6495890a23989ee777fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:44:28Z,use_quota=True,user_id='2a1250f2dfbd4029aedff6c4ce97a45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453ff02a-9ace-43a2-89d2-ad211e78acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453ff02a-9ace-43a2-89d2-ad211e78acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1176d2-bd16-466b-ab40-a18734a077a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1176d2-bd16-466b-ab40-a18734a077a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1144bb9e-8420-4848-b1de-c971b79df860', 'volume_name': 'volume-1144bb9e-8420-4848-b1de-c971b79df860', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e996d3fd-aa46-44e1-ab7d-72460a8feb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e996d3fd-aa46-44e1-ab7d-72460a8feb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83d37db-0022-48e5-81c9-cfa9aa081ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:29 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume 1144bb9e-8420-4848-b1de-c971b79df860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1144bb9e-8420-4848-b1de-c971b79df860', 'volume_size': 1} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da" returned: 0 in 0.623s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] <== create_volume: return (1395ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.038s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1716106981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1144bb9e-8420-4848-b1de-c971b79df860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ffaa212ef6495890a23989ee777fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:44:28Z,use_quota=True,user_id='2a1250f2dfbd4029aedff6c4ce97a45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Creating volume 1144bb9e-8420-4848-b1de-c971b79df860 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:44:29 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:44:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1144bb9e-8420-4848-b1de-c971b79df860 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:44:30 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=122, name=volume-1144bb9e-8420-4848-b1de-c971b79df860, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:44:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73dd029-c400-4232-b00c-4822dd77a1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242df4da-b204-4c3b-820a-e9fd49101af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1144bb9e-8420-4848-b1de-c971b79df860 1073741824" returned: 0 in 0.618s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:44:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1144bb9e-8420-4848-b1de-c971b79df860 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:44:30 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da (040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da): created successfully Sep 17 18:44:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242df4da-b204-4c3b-820a-e9fd49101af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Flow 'volume_create_manager' (10950748-97f1-46c9-951a-3751b1592cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:44:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1144bb9e-8420-4848-b1de-c971b79df860" returned: 0 in 0.408s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:44:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] <== create_volume: return (1066ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:44:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:44:30 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-12e9b948-be2c-475b-bf6d-95cf76c9aa34 tempest-TestServerVolumeAttachmentScenario-6441486 None] Created volume successfully. Sep 17 18:44:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83d37db-0022-48e5-81c9-cfa9aa081ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1144bb9e-8420-4848-b1de-c971b79df860', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:30 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f588da28-619d-4979-961b-683c6cc15831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:44:31 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume volume-1144bb9e-8420-4848-b1de-c971b79df860 (1144bb9e-8420-4848-b1de-c971b79df860): created successfully Sep 17 18:44:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f588da28-619d-4979-961b-683c6cc15831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:44:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Flow 'volume_create_manager' (06a3cd8f-8fb7-4818-b4f5-1bb6ac852c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:44:31 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-f32fdf5d-95b2-47f2-bd9e-ff74b97d4e27 tempest-TestServerVolumeAttachmentScenario-6441486 None] Created volume successfully. Sep 17 18:44:41 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:44:41 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:45:13 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-85a09556-c9d9-4e15-829e-d33376a1a1a5 req-34f66436-a5bc-40c1-bfaf-741aee19d016 tempest-TestShelveInstance-2016185709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:45:13 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-85a09556-c9d9-4e15-829e-d33376a1a1a5 req-34f66436-a5bc-40c1-bfaf-741aee19d016 tempest-TestShelveInstance-2016185709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:45:13 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-85a09556-c9d9-4e15-829e-d33376a1a1a5 req-34f66436-a5bc-40c1-bfaf-741aee19d016 tempest-TestShelveInstance-2016185709 None] Terminate volume connection completed successfully. Sep 17 18:45:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-85a09556-c9d9-4e15-829e-d33376a1a1a5 req-34f66436-a5bc-40c1-bfaf-741aee19d016 tempest-TestShelveInstance-2016185709 None] Deleting attachment 3934cae4-8393-49f1-8886-8f568109b149. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:45:17 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:45:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:45:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:45:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:45:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:45:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:45:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:45:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.115s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:45:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:45:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-fb0de0c2-a13c-4492-a415-102bbb06fbca req-1ffe7c0a-14fb-4ce0-8e53-d11c3b99a0af tempest-TestShelveInstance-2016185709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:45:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-fb0de0c2-a13c-4492-a415-102bbb06fbca req-1ffe7c0a-14fb-4ce0-8e53-d11c3b99a0af tempest-TestShelveInstance-2016185709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:45:20 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[763bd2cf-68f3-4c0c-8630-af6626e60653]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:45:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-fb0de0c2-a13c-4492-a415-102bbb06fbca req-1ffe7c0a-14fb-4ce0-8e53-d11c3b99a0af tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:45:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-fb0de0c2-a13c-4492-a415-102bbb06fbca req-1ffe7c0a-14fb-4ce0-8e53-d11c3b99a0af tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235" returned: 0 in 0.415s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:45:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-fb0de0c2-a13c-4492-a415-102bbb06fbca req-1ffe7c0a-14fb-4ce0-8e53-d11c3b99a0af tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:45:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-fb0de0c2-a13c-4492-a415-102bbb06fbca req-1ffe7c0a-14fb-4ce0-8e53-d11c3b99a0af tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235" returned: 1 in 0.454s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:45:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-fb0de0c2-a13c-4492-a415-102bbb06fbca req-1ffe7c0a-14fb-4ce0-8e53-d11c3b99a0af tempest-TestShelveInstance-2016185709 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:45:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-fb0de0c2-a13c-4492-a415-102bbb06fbca req-1ffe7c0a-14fb-4ce0-8e53-d11c3b99a0af tempest-TestShelveInstance-2016185709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.047s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:45:21 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-fb0de0c2-a13c-4492-a415-102bbb06fbca req-1ffe7c0a-14fb-4ce0-8e53-d11c3b99a0af tempest-TestShelveInstance-2016185709 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-499b291a-fa0d-4d41-8690-83916252c235', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9389b5cd-f6f2-49d6-a54b-1897bde340c6', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:45:21 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-fb0de0c2-a13c-4492-a415-102bbb06fbca req-1ffe7c0a-14fb-4ce0-8e53-d11c3b99a0af tempest-TestShelveInstance-2016185709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:45:22 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-fb0de0c2-a13c-4492-a415-102bbb06fbca req-1ffe7c0a-14fb-4ce0-8e53-d11c3b99a0af tempest-TestShelveInstance-2016185709 None] attachment_update completed successfully. Sep 17 18:45:32 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:45:32 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:46:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-e3f8ae8b-b049-48df-b2cf-179d5990081b req-009943f9-ed2d-4175-bcb7-b0aaca33d548 tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:46:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-e3f8ae8b-b049-48df-b2cf-179d5990081b req-009943f9-ed2d-4175-bcb7-b0aaca33d548 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:46:06 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db6cc35-f803-4be6-8638-4d9afffedbc5]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:46:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-e3f8ae8b-b049-48df-b2cf-179d5990081b req-009943f9-ed2d-4175-bcb7-b0aaca33d548 tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:46:07 devstack quobyte-client[83739]: System call of process 98897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:46:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-e3f8ae8b-b049-48df-b2cf-179d5990081b req-009943f9-ed2d-4175-bcb7-b0aaca33d548 tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da" returned: 0 in 0.586s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:46:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-e3f8ae8b-b049-48df-b2cf-179d5990081b req-009943f9-ed2d-4175-bcb7-b0aaca33d548 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.647s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:46:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-e3f8ae8b-b049-48df-b2cf-179d5990081b req-009943f9-ed2d-4175-bcb7-b0aaca33d548 tempest-TestServerVolumeAttachmentScenario-6441486 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f3d13d3-5a73-4485-a394-5a668d41a0f1', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:46:07 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-e3f8ae8b-b049-48df-b2cf-179d5990081b req-009943f9-ed2d-4175-bcb7-b0aaca33d548 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:46:07 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-e3f8ae8b-b049-48df-b2cf-179d5990081b req-009943f9-ed2d-4175-bcb7-b0aaca33d548 tempest-TestServerVolumeAttachmentScenario-6441486 None] attachment_update completed successfully. Sep 17 18:46:17 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:46:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:46:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:46:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:46:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:46:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:46:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:46:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.097s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:46:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:46:17 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:46:17 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=7 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:46:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-d7324c24-e927-4673-913b-a20e728e693a req-21d97e35-f022-47ee-bee7-9b2c663465ef tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:46:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-d7324c24-e927-4673-913b-a20e728e693a req-21d97e35-f022-47ee-bee7-9b2c663465ef tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:46:19 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb5f0aa-59c8-4be2-a1f8-74d0d60dbe4f]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:46:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-d7324c24-e927-4673-913b-a20e728e693a req-21d97e35-f022-47ee-bee7-9b2c663465ef tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1144bb9e-8420-4848-b1de-c971b79df860 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:46:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-d7324c24-e927-4673-913b-a20e728e693a req-21d97e35-f022-47ee-bee7-9b2c663465ef tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1144bb9e-8420-4848-b1de-c971b79df860" returned: 0 in 0.390s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:46:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-d7324c24-e927-4673-913b-a20e728e693a req-21d97e35-f022-47ee-bee7-9b2c663465ef tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.443s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:46:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-d7324c24-e927-4673-913b-a20e728e693a req-21d97e35-f022-47ee-bee7-9b2c663465ef tempest-TestServerVolumeAttachmentScenario-6441486 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a', 'name': 'volume-1144bb9e-8420-4848-b1de-c971b79df860', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fe5d3e2-e82d-433d-aeef-e7f81f3a08ab', 'enforce_multipath': True} {{(pid=83736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 18:46:19 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-d7324c24-e927-4673-913b-a20e728e693a req-21d97e35-f022-47ee-bee7-9b2c663465ef tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:46:19 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-d7324c24-e927-4673-913b-a20e728e693a req-21d97e35-f022-47ee-bee7-9b2c663465ef tempest-TestServerVolumeAttachmentScenario-6441486 None] attachment_update completed successfully. Sep 17 18:46:29 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:46:29 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:46:48 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-7a9dfdd9-7ce9-445a-831a-6a93e7f85ba9 req-c2a4b31c-066a-4188-96a2-6b48de79dd2b tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:46:48 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-7a9dfdd9-7ce9-445a-831a-6a93e7f85ba9 req-c2a4b31c-066a-4188-96a2-6b48de79dd2b tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:46:48 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-7a9dfdd9-7ce9-445a-831a-6a93e7f85ba9 req-c2a4b31c-066a-4188-96a2-6b48de79dd2b tempest-TestServerVolumeAttachmentScenario-6441486 None] Terminate volume connection completed successfully. Sep 17 18:46:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-7a9dfdd9-7ce9-445a-831a-6a93e7f85ba9 req-c2a4b31c-066a-4188-96a2-6b48de79dd2b tempest-TestServerVolumeAttachmentScenario-6441486 None] Deleting attachment 4fe5d3e2-e82d-433d-aeef-e7f81f3a08ab. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:46:53 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-14b16d11-5095-43de-bb29-5e1b6bd07500 tempest-TestShelveInstance-2016185709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:46:53 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-14b16d11-5095-43de-bb29-5e1b6bd07500 tempest-TestShelveInstance-2016185709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:46:53 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-14b16d11-5095-43de-bb29-5e1b6bd07500 tempest-TestShelveInstance-2016185709 None] Terminate volume connection completed successfully. Sep 17 18:46:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-14b16d11-5095-43de-bb29-5e1b6bd07500 tempest-TestShelveInstance-2016185709 None] Deleting attachment 9389b5cd-f6f2-49d6-a54b-1897bde340c6. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:46:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Acquiring lock "cinder-499b291a-fa0d-4d41-8690-83916252c235-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:46:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Lock "cinder-499b291a-fa0d-4d41-8690-83916252c235-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:46:54 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:46:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Acquiring lock "cinder-quobyte-499b291a-fa0d-4d41-8690-83916252c235" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:46:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Lock "cinder-quobyte-499b291a-fa0d-4d41-8690-83916252c235" acquired by "delete_volume" :: waited 0.015s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:46:54 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cfdf9d-563d-448f-adf8-7077710b682d]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:46:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:46:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235" returned: 0 in 0.414s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:46:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:46:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235" returned: 1 in 0.379s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:46:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:46:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:46:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-499b291a-fa0d-4d41-8690-83916252c235" returned: 0 in 0.166s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:46:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Lock "cinder-quobyte-499b291a-fa0d-4d41-8690-83916252c235" released by "delete_volume" :: held 1.191s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:46:55 devstack cinder-volume[83736]: DEBUG cinder.quota [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Created reservations ['312823e5-795b-4f65-bc8e-ec5289d21757', 'c20e4664-578c-40d4-9190-38ccb1c590f6', 'da8ff434-56e9-4bd9-b01a-19571e29e49f', '55ee98df-0d36-4bf5-99cd-c9e021060a8c'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:46:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:46:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:46:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:46:56 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:46:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:46:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:46:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.089s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:46:56 devstack cinder-volume[83736]: DEBUG cinder.manager [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:46:56 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Deleted volume successfully. Sep 17 18:46:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [req-faa0b01b-224f-4af6-b240-e41bb9c09d16 req-b417e720-ef17-4a8b-ac92-efd7de062516 tempest-TestShelveInstance-2016185709 None] Lock "cinder-499b291a-fa0d-4d41-8690-83916252c235-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:06 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:47:06 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:47:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-52201388-706d-41fd-9a96-9cad59cf6153 req-4de627a1-c541-40b8-9ec7-d78d71358798 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [req-52201388-706d-41fd-9a96-9cad59cf6153 req-4de627a1-c541-40b8-9ec7-d78d71358798 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:12 devstack cinder-volume[83736]: INFO cinder.volume.manager [req-52201388-706d-41fd-9a96-9cad59cf6153 req-4de627a1-c541-40b8-9ec7-d78d71358798 tempest-TestServerVolumeAttachmentScenario-6441486 None] Terminate volume connection completed successfully. Sep 17 18:47:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [req-52201388-706d-41fd-9a96-9cad59cf6153 req-4de627a1-c541-40b8-9ec7-d78d71358798 tempest-TestServerVolumeAttachmentScenario-6441486 None] Deleting attachment 4f3d13d3-5a73-4485-a394-5a668d41a0f1. {{(pid=83736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 18:47:15 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:15 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:15 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Flow 'volume_create_manager' (209a05e0-2941-4bc3-8ef2-09c0bd58a08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a6832b-906b-46b1-a667-7297bd5cf87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a6832b-906b-46b1-a667-7297bd5cf87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1210547831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2d4bd8-b94f-42af-8fb9-0003dc9879fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efe93e95c6184db891bd9da4e8728c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:16Z,use_quota=True,user_id='b6b2b26e1c1a48f385c31907d7fefa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff466664-c24b-4aad-938f-1ae348bbc0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff466664-c24b-4aad-938f-1ae348bbc0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8cad047-97c6-448a-9b51-7a69b417e972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8cad047-97c6-448a-9b51-7a69b417e972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2d4bd8-b94f-42af-8fb9-0003dc9879fb', 'volume_name': 'volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6cc582-ec34-48de-83aa-357813bc740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6cc582-ec34-48de-83aa-357813bc740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a320283f-c22f-4674-ac8e-fee0245498ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:16 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Volume 6a2d4bd8-b94f-42af-8fb9-0003dc9879fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb', 'volume_size': 1} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1210547831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2d4bd8-b94f-42af-8fb9-0003dc9879fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efe93e95c6184db891bd9da4e8728c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:16Z,use_quota=True,user_id='b6b2b26e1c1a48f385c31907d7fefa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Creating volume 6a2d4bd8-b94f-42af-8fb9-0003dc9879fb {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:16 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:16 devstack quobyte-client[83739]: System call of process 99114 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:47:17 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=123, name=volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:17 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:47:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb 1073741824" returned: 0 in 1.739s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 1.262s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:18 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:19 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Flow 'volume_create_manager' (9f3d50df-dcd6-4358-aea4-4aaf151e7fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bf7462-dcc8-4e9c-a836-a6257aebe789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:19 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:47:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bf7462-dcc8-4e9c-a836-a6257aebe789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-69541102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa652a71-b5f8-490d-9937-ee53347ca37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efe93e95c6184db891bd9da4e8728c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:16Z,use_quota=True,user_id='b6b2b26e1c1a48f385c31907d7fefa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d26c65-07a9-41ec-a8df-70cea30d73d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d26c65-07a9-41ec-a8df-70cea30d73d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686afda6-5488-4250-b9e0-1c1204a22113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:19 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686afda6-5488-4250-b9e0-1c1204a22113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa652a71-b5f8-490d-9937-ee53347ca37e', 'volume_name': 'volume-fa652a71-b5f8-490d-9937-ee53347ca37e', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c75b9a8-b7ec-4a6e-b9f3-2074c50fb589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c75b9a8-b7ec-4a6e-b9f3-2074c50fb589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d6dc07-fcca-4b79-8dcf-841b87b1def0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Volume fa652a71-b5f8-490d-9937-ee53347ca37e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa652a71-b5f8-490d-9937-ee53347ca37e', 'volume_size': 1} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:20 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Flow 'volume_create_manager' (f913091c-753e-4b1f-b139-1527fbb85b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd356d36-e77b-43c2-81a1-3f3bc08951bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd356d36-e77b-43c2-81a1-3f3bc08951bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-227748629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760b8989-2b7a-4456-82eb-ebeb84ff9585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efe93e95c6184db891bd9da4e8728c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:18Z,use_quota=True,user_id='b6b2b26e1c1a48f385c31907d7fefa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d21bb8-3298-4f76-8a5d-abb30c4aba7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d21bb8-3298-4f76-8a5d-abb30c4aba7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c4d026-56f5-40d6-96bf-3897d093762f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c4d026-56f5-40d6-96bf-3897d093762f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760b8989-2b7a-4456-82eb-ebeb84ff9585', 'volume_name': 'volume-760b8989-2b7a-4456-82eb-ebeb84ff9585', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b16397-0370-4688-bf82-724413939f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b16397-0370-4688-bf82-724413939f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc70577-9fca-4424-ab34-4d4548fac4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Volume 760b8989-2b7a-4456-82eb-ebeb84ff9585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760b8989-2b7a-4456-82eb-ebeb84ff9585', 'volume_size': 1} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:20 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Flow 'volume_create_manager' (53369bb2-163e-442c-8f2d-9433625f39b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceffb562-01f8-4414-98a1-625b9039d0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb" returned: 0 in 2.320s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceffb562-01f8-4414-98a1-625b9039d0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-491852857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4458170c-24c5-4da3-a15f-544a801d9e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efe93e95c6184db891bd9da4e8728c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:19Z,use_quota=True,user_id='b6b2b26e1c1a48f385c31907d7fefa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11bfc73-3188-452e-9080-d3f07a590d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11bfc73-3188-452e-9080-d3f07a590d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd624b06-2035-4486-9e93-811aa2d65291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd624b06-2035-4486-9e93-811aa2d65291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4458170c-24c5-4da3-a15f-544a801d9e74', 'volume_name': 'volume-4458170c-24c5-4da3-a15f-544a801d9e74', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309de2b2-b13d-4ef2-89d3-b7802b22399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309de2b2-b13d-4ef2-89d3-b7802b22399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab297e2-b01b-4b71-99d9-471cb201fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:20 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Volume 4458170c-24c5-4da3-a15f-544a801d9e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4458170c-24c5-4da3-a15f-544a801d9e74', 'volume_size': 1} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] <== create_volume: return (4193ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.224s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-69541102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa652a71-b5f8-490d-9937-ee53347ca37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efe93e95c6184db891bd9da4e8728c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:16Z,use_quota=True,user_id='b6b2b26e1c1a48f385c31907d7fefa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Creating volume fa652a71-b5f8-490d-9937-ee53347ca37e {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:20 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fa652a71-b5f8-490d-9937-ee53347ca37e 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:20 devstack quobyte-client[83739]: System call of process 99162 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:47:20 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=124, name=volume-fa652a71-b5f8-490d-9937-ee53347ca37e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:21 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a320283f-c22f-4674-ac8e-fee0245498ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:21 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c19659d-3b0d-48d9-9c99-115ff048a41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:21 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:21 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Flow 'volume_create_manager' (c1ca23e3-d9ac-4725-a831-5735bba1a826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d4b61b-02eb-4e9b-a48e-6f0f6c06b3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fa652a71-b5f8-490d-9937-ee53347ca37e 1073741824" returned: 0 in 1.421s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:22 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Volume volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb (6a2d4bd8-b94f-42af-8fb9-0003dc9879fb): created successfully Sep 17 18:47:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c19659d-3b0d-48d9-9c99-115ff048a41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:22 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Flow 'volume_create_manager' (209a05e0-2941-4bc3-8ef2-09c0bd58a08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fa652a71-b5f8-490d-9937-ee53347ca37e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d4b61b-02eb-4e9b-a48e-6f0f6c06b3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-883141791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2439436-b2df-4dc8-8610-63897df92103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efe93e95c6184db891bd9da4e8728c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:19Z,use_quota=True,user_id='b6b2b26e1c1a48f385c31907d7fefa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7eaea7a-1137-44b3-999b-4ee02e714661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7eaea7a-1137-44b3-999b-4ee02e714661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8563689e-2111-45c9-b7ac-62472cf9a0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8563689e-2111-45c9-b7ac-62472cf9a0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2439436-b2df-4dc8-8610-63897df92103', 'volume_name': 'volume-c2439436-b2df-4dc8-8610-63897df92103', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb635f7-41f7-42ab-b01e-1fc9c84933e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb635f7-41f7-42ab-b01e-1fc9c84933e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a891b1-efab-4f8b-a89d-1864d785f721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:23 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Volume c2439436-b2df-4dc8-8610-63897df92103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2439436-b2df-4dc8-8610-63897df92103', 'volume_size': 1} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fa652a71-b5f8-490d-9937-ee53347ca37e" returned: 0 in 1.114s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:23 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-41cf378c-025a-4876-87e2-00717d5e76f9 tempest-CreateVolumesFromImageTest-1796605677 None] Created volume successfully. Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] <== create_volume: return (2715ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.729s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.894s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-227748629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760b8989-2b7a-4456-82eb-ebeb84ff9585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efe93e95c6184db891bd9da4e8728c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:18Z,use_quota=True,user_id='b6b2b26e1c1a48f385c31907d7fefa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Creating volume 760b8989-2b7a-4456-82eb-ebeb84ff9585 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:23 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-760b8989-2b7a-4456-82eb-ebeb84ff9585 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:23 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=125, name=volume-760b8989-2b7a-4456-82eb-ebeb84ff9585, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d6dc07-fcca-4b79-8dcf-841b87b1def0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa652a71-b5f8-490d-9937-ee53347ca37e', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f9b7b8-e533-43a2-9fb2-1789d1ecefd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:24 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Volume volume-fa652a71-b5f8-490d-9937-ee53347ca37e (fa652a71-b5f8-490d-9937-ee53347ca37e): created successfully Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f9b7b8-e533-43a2-9fb2-1789d1ecefd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Flow 'volume_create_manager' (9f3d50df-dcd6-4358-aea4-4aaf151e7fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-760b8989-2b7a-4456-82eb-ebeb84ff9585 1073741824" returned: 0 in 0.916s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-760b8989-2b7a-4456-82eb-ebeb84ff9585 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:24 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-081b7b17-18de-47bf-a524-72b659883bfc tempest-CreateVolumesFromImageTest-1796605677 None] Created volume successfully. Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-760b8989-2b7a-4456-82eb-ebeb84ff9585" returned: 0 in 0.351s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] <== create_volume: return (1314ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.152s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-491852857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4458170c-24c5-4da3-a15f-544a801d9e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efe93e95c6184db891bd9da4e8728c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:19Z,use_quota=True,user_id='b6b2b26e1c1a48f385c31907d7fefa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Creating volume 4458170c-24c5-4da3-a15f-544a801d9e74 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:24 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4458170c-24c5-4da3-a15f-544a801d9e74 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:24 devstack quobyte-client[83739]: System call of process 99225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:47:24 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=126, name=volume-4458170c-24c5-4da3-a15f-544a801d9e74, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc70577-9fca-4424-ab34-4d4548fac4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760b8989-2b7a-4456-82eb-ebeb84ff9585', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b01b78e-9c6d-4de6-acc7-7e2ec1290b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:25 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Volume volume-760b8989-2b7a-4456-82eb-ebeb84ff9585 (760b8989-2b7a-4456-82eb-ebeb84ff9585): created successfully Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b01b78e-9c6d-4de6-acc7-7e2ec1290b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Flow 'volume_create_manager' (f913091c-753e-4b1f-b139-1527fbb85b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4458170c-24c5-4da3-a15f-544a801d9e74 1073741824" returned: 0 in 0.498s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4458170c-24c5-4da3-a15f-544a801d9e74 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:25 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-8bf9733b-fd72-493e-a1b3-91101e0605df tempest-CreateVolumesFromImageTest-1796605677 None] Created volume successfully. Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4458170c-24c5-4da3-a15f-544a801d9e74" returned: 0 in 0.254s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] <== create_volume: return (783ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-883141791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2439436-b2df-4dc8-8610-63897df92103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efe93e95c6184db891bd9da4e8728c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:19Z,use_quota=True,user_id='b6b2b26e1c1a48f385c31907d7fefa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Creating volume c2439436-b2df-4dc8-8610-63897df92103 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:25 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2439436-b2df-4dc8-8610-63897df92103 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:25 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=127, name=volume-c2439436-b2df-4dc8-8610-63897df92103, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab297e2-b01b-4b71-99d9-471cb201fa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4458170c-24c5-4da3-a15f-544a801d9e74', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4184c773-6175-4946-b099-ab8160897477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:26 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Volume volume-4458170c-24c5-4da3-a15f-544a801d9e74 (4458170c-24c5-4da3-a15f-544a801d9e74): created successfully Sep 17 18:47:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4184c773-6175-4946-b099-ab8160897477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Flow 'volume_create_manager' (53369bb2-163e-442c-8f2d-9433625f39b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2439436-b2df-4dc8-8610-63897df92103 1073741824" returned: 0 in 0.479s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2439436-b2df-4dc8-8610-63897df92103 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:26 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7cefee47-f406-4c6e-8dab-2d38f241c159 tempest-CreateVolumesFromImageTest-1796605677 None] Created volume successfully. Sep 17 18:47:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2439436-b2df-4dc8-8610-63897df92103" returned: 0 in 0.334s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] <== create_volume: return (850ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:47:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a891b1-efab-4f8b-a89d-1864d785f721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2439436-b2df-4dc8-8610-63897df92103', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c19164-d8ad-48ca-b993-9b6981addbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:26 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Volume volume-c2439436-b2df-4dc8-8610-63897df92103 (c2439436-b2df-4dc8-8610-63897df92103): created successfully Sep 17 18:47:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c19164-d8ad-48ca-b993-9b6981addbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Flow 'volume_create_manager' (c1ca23e3-d9ac-4725-a831-5735bba1a826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:26 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-b6b9ccf4-23eb-4ca9-939f-d505ae18db6b tempest-CreateVolumesFromImageTest-1796605677 None] Created volume successfully. Sep 17 18:47:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "cinder-4458170c-24c5-4da3-a15f-544a801d9e74-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-4458170c-24c5-4da3-a15f-544a801d9e74-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "cinder-quobyte-4458170c-24c5-4da3-a15f-544a801d9e74" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-quobyte-4458170c-24c5-4da3-a15f-544a801d9e74" acquired by "delete_volume" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:28 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a024850f-aa0e-4bd5-a6d3-402df400c6de]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:47:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4458170c-24c5-4da3-a15f-544a801d9e74 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4458170c-24c5-4da3-a15f-544a801d9e74" returned: 0 in 0.411s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4458170c-24c5-4da3-a15f-544a801d9e74 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4458170c-24c5-4da3-a15f-544a801d9e74" returned: 0 in 0.118s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-quobyte-4458170c-24c5-4da3-a15f-544a801d9e74" released by "delete_volume" :: held 0.708s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:29 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Created reservations ['a8cd86bc-3313-410d-9f26-8b3468dc504b', 'd6a0e396-4358-4574-ba26-3f87c180fe04', 'c1f792ee-3217-4c30-a3f0-af8cbb19ec02', 'fd5afee1-e438-4639-8947-550d4672450c'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:47:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.112s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:29 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:47:29 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Deleted volume successfully. Sep 17 18:47:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cce33c8b-99e8-46d4-a629-8f4600b978b9 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-4458170c-24c5-4da3-a15f-544a801d9e74-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:29 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "cinder-1144bb9e-8420-4848-b1de-c971b79df860-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "cinder-1144bb9e-8420-4848-b1de-c971b79df860-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:30 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "cinder-quobyte-1144bb9e-8420-4848-b1de-c971b79df860" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "cinder-quobyte-1144bb9e-8420-4848-b1de-c971b79df860" acquired by "delete_volume" :: waited 0.012s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:30 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f58d847-a724-4026-82f1-c71b6548b8de]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:47:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1144bb9e-8420-4848-b1de-c971b79df860 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "cinder-c2439436-b2df-4dc8-8610-63897df92103-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-c2439436-b2df-4dc8-8610-63897df92103-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1144bb9e-8420-4848-b1de-c971b79df860" returned: 0 in 0.555s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1144bb9e-8420-4848-b1de-c971b79df860 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:31 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "cinder-quobyte-c2439436-b2df-4dc8-8610-63897df92103" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1144bb9e-8420-4848-b1de-c971b79df860" returned: 0 in 0.400s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-quobyte-c2439436-b2df-4dc8-8610-63897df92103" acquired by "delete_volume" :: waited 0.067s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:31 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "cinder-quobyte-1144bb9e-8420-4848-b1de-c971b79df860" released by "delete_volume" :: held 1.036s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:31 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a37490-260c-4606-b47b-b808734f4076]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:47:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2439436-b2df-4dc8-8610-63897df92103 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2439436-b2df-4dc8-8610-63897df92103" returned: 0 in 0.475s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2439436-b2df-4dc8-8610-63897df92103 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2439436-b2df-4dc8-8610-63897df92103" returned: 0 in 0.083s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:31 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Created reservations ['d78cb4bc-9924-45b6-bd6b-f82dfe8d61ec', '8b39f164-b316-4fea-ad5d-6153151c9bd6', 'e5be5c72-f8c0-49ad-be6d-688924ec186c', '9e7cccde-403c-48e0-b280-b64c71da76d4'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-quobyte-c2439436-b2df-4dc8-8610-63897df92103" released by "delete_volume" :: held 0.862s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Created reservations ['5e87be64-6001-4ff1-9a66-22736eeddaca', 'f641f0e4-1816-4e90-8c23-b61d98578606', '372205c4-e474-4ae1-9ad8-cbfff87450e5', '321cb3f3-1ee9-4416-ab18-03bd0ba44b49'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.220s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:47:32 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Deleted volume successfully. Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.320s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "cinder-760b8989-2b7a-4456-82eb-ebeb84ff9585-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:32 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Deleted volume successfully. Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-5dfd4fb9-4029-40f2-9f4f-73326cc6ad54 tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "cinder-1144bb9e-8420-4848-b1de-c971b79df860-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-760b8989-2b7a-4456-82eb-ebeb84ff9585-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-33c77bd6-7a33-48ee-b657-c6d3d307e1d4 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-c2439436-b2df-4dc8-8610-63897df92103-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "cinder-quobyte-760b8989-2b7a-4456-82eb-ebeb84ff9585" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-quobyte-760b8989-2b7a-4456-82eb-ebeb84ff9585" acquired by "delete_volume" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:33 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[474953e9-287a-4334-b441-fd441fed265c]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:47:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-760b8989-2b7a-4456-82eb-ebeb84ff9585 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "cinder-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "cinder-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-760b8989-2b7a-4456-82eb-ebeb84ff9585" returned: 0 in 0.600s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-760b8989-2b7a-4456-82eb-ebeb84ff9585 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "cinder-quobyte-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-760b8989-2b7a-4456-82eb-ebeb84ff9585" returned: 0 in 0.245s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-quobyte-760b8989-2b7a-4456-82eb-ebeb84ff9585" released by "delete_volume" :: held 0.911s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "cinder-quobyte-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da" acquired by "delete_volume" :: waited 0.210s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b20d5d-eb0f-4985-94b3-6cd8078aa925]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Created reservations ['71c0e978-a926-47f5-8d0a-153f5f4b0050', 'c55c3966-065f-40e5-99af-32d55b0cd5f4', '10352b53-1ca5-41db-b3fd-a3e562631cee', '1542bf34-bbf5-4911-b0e8-1a2e2d32167c'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da" returned: 0 in 0.596s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da" returned: 0 in 0.125s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.321s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "cinder-fa652a71-b5f8-490d-9937-ee53347ca37e-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "cinder-quobyte-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da" released by "delete_volume" :: held 1.009s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Deleted volume successfully. Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-fa652a71-b5f8-490d-9937-ee53347ca37e-delete_volume" acquired by "delete_volume" :: waited 0.210s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-b58699f9-83a4-4648-83d0-ec49062e3df2 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-760b8989-2b7a-4456-82eb-ebeb84ff9585-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "cinder-quobyte-fa652a71-b5f8-490d-9937-ee53347ca37e" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Created reservations ['955f7868-167c-4f3f-a7c0-55acffccea88', 'f5e004ef-d3dc-4ab6-8770-dbd86267a025', '196cc7ce-1a32-4ca8-86b9-4dc5f15c3890', 'dd612556-c918-4e98-b707-bd43990768b4'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-quobyte-fa652a71-b5f8-490d-9937-ee53347ca37e" acquired by "delete_volume" :: waited 0.029s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae6e95f-02c9-40f9-b091-c29027f0858a]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fa652a71-b5f8-490d-9937-ee53347ca37e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fa652a71-b5f8-490d-9937-ee53347ca37e" returned: 0 in 0.617s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fa652a71-b5f8-490d-9937-ee53347ca37e {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.236s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:47:36 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Deleted volume successfully. Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fa652a71-b5f8-490d-9937-ee53347ca37e" returned: 0 in 0.293s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-quobyte-fa652a71-b5f8-490d-9937-ee53347ca37e" released by "delete_volume" :: held 1.023s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db9b1725-312e-4eda-a1ab-9418ef46632f tempest-TestServerVolumeAttachmentScenario-6441486 None] Lock "cinder-040f6ac1-7f7f-4b27-9b16-0b70c0b9e0da-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Created reservations ['d15d142e-a60d-4552-86e1-d970654a5a58', 'd0e66079-6917-45ae-a61c-1972fdefba7d', 'ffe3df44-b4ee-46fa-92ac-498052069c8a', '07cd58d8-83cf-4708-8b07-d2f2f39dce0a'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.198s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:37 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:47:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Deleted volume successfully. Sep 17 18:47:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "cinder-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e923643b-8b44-407e-92f3-05fc6f4963ac tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-fa652a71-b5f8-490d-9937-ee53347ca37e-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:37 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "cinder-quobyte-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-quobyte-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb" acquired by "delete_volume" :: waited 0.022s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:37 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a80205-21e4-45e5-88ef-e4efcf674832]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:47:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb" returned: 0 in 0.490s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb" returned: 0 in 0.097s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-quobyte-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb" released by "delete_volume" :: held 0.772s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:38 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Created reservations ['e8feae30-8a6d-48d2-be6c-4bf029ce271f', 'a71ba255-6b01-496f-b745-97a690115321', 'c38e5c91-5b1d-45d3-95cb-23b717a7268b', '71de3433-7b31-4609-aab5-aea5ff5c4144'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:47:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:39 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:39 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.203s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:39 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:47:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Deleted volume successfully. Sep 17 18:47:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-88eb896e-a919-462a-a89b-3115e9093639 tempest-CreateVolumesFromImageTest-1796605677 None] Lock "cinder-6a2d4bd8-b94f-42af-8fb9-0003dc9879fb-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:43 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (77e3c522-4931-4b43-967e-ebbf43b5c155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48152a1c-1c3f-4386-b85d-81b019cfa839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48152a1c-1c3f-4386-b85d-81b019cfa839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-77884487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2b10b4-0a73-4f6f-a85d-affbf1873a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:44Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb76a78-4c72-4d66-88a1-f9322c8ea288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb76a78-4c72-4d66-88a1-f9322c8ea288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abc1e19-ecc0-49bd-87f3-0f6c39fbf3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abc1e19-ecc0-49bd-87f3-0f6c39fbf3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2b10b4-0a73-4f6f-a85d-affbf1873a53', 'volume_name': 'volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7762a5df-c345-4ae6-a392-6db948fb522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7762a5df-c345-4ae6-a392-6db948fb522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b7b99b-c464-424b-8258-9aef2a19ba1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:44 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume 8c2b10b4-0a73-4f6f-a85d-affbf1873a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53', 'volume_size': 1} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-77884487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2b10b4-0a73-4f6f-a85d-affbf1873a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:44Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Creating volume 8c2b10b4-0a73-4f6f-a85d-affbf1873a53 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:44 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:44 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=128, name=volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53 1073741824" returned: 0 in 0.357s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53" returned: 0 in 0.108s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] <== create_volume: return (554ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.568s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b7b99b-c464-424b-8258-9aef2a19ba1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e762a5d5-e07d-4266-a7b1-8504899d164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:45 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53 (8c2b10b4-0a73-4f6f-a85d-affbf1873a53): created successfully Sep 17 18:47:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e762a5d5-e07d-4266-a7b1-8504899d164d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (77e3c522-4931-4b43-967e-ebbf43b5c155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:45 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-182b462d-b130-4f06-9065-26bf8ae6ad2a tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created volume successfully. Sep 17 18:47:46 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (5e6f4837-c57f-41e1-8738-83bd4eaf989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6870f04-970e-48c2-8c1f-c0c8ecbc745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6870f04-970e-48c2-8c1f-c0c8ecbc745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1402474250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a634a827-c1c5-4c2d-af6a-946d5588cb87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:47Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b2c230-2885-4d94-93c6-f08ef5c14ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b2c230-2885-4d94-93c6-f08ef5c14ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e229ac-3ddf-4ff9-ac8d-dfd886143a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e229ac-3ddf-4ff9-ac8d-dfd886143a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a634a827-c1c5-4c2d-af6a-946d5588cb87', 'volume_name': 'volume-a634a827-c1c5-4c2d-af6a-946d5588cb87', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e8c986-15f9-4e12-8641-d9da49a0b4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e8c986-15f9-4e12-8641-d9da49a0b4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc933793-218f-47b5-86c4-4e72f9aac2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:46 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume a634a827-c1c5-4c2d-af6a-946d5588cb87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a634a827-c1c5-4c2d-af6a-946d5588cb87', 'volume_size': 1} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1402474250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a634a827-c1c5-4c2d-af6a-946d5588cb87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:47Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Creating volume a634a827-c1c5-4c2d-af6a-946d5588cb87 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:47 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a634a827-c1c5-4c2d-af6a-946d5588cb87 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:47 devstack quobyte-client[83739]: System call of process 99278 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:47:47 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=129, name=volume-a634a827-c1c5-4c2d-af6a-946d5588cb87, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a634a827-c1c5-4c2d-af6a-946d5588cb87 1073741824" returned: 0 in 0.965s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a634a827-c1c5-4c2d-af6a-946d5588cb87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:48 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:48 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (94f1078b-b8fb-48b8-8f37-1abceaf6b1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ebcc78-4528-4d4a-9385-41b34a93fa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:48 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:48 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (bfd610f4-e8b3-4500-8b73-d19212493b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6107ee41-6d92-4b08-989a-af1f2598fc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ebcc78-4528-4d4a-9385-41b34a93fa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235432223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4acb54-3890-47be-b47d-95bb6f55bedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:48Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8c1026-9069-4e65-abb8-58da6ffd9bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8c1026-9069-4e65-abb8-58da6ffd9bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843a8b6f-b52f-438d-b3a5-a6e2fc00dc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843a8b6f-b52f-438d-b3a5-a6e2fc00dc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4acb54-3890-47be-b47d-95bb6f55bedc', 'volume_name': 'volume-fd4acb54-3890-47be-b47d-95bb6f55bedc', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1bf055-9784-442e-bfa9-6eaa1b7ecd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1bf055-9784-442e-bfa9-6eaa1b7ecd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063ff029-457c-47b3-bca7-f11384b34330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume fd4acb54-3890-47be-b47d-95bb6f55bedc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4acb54-3890-47be-b47d-95bb6f55bedc', 'volume_size': 1} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6107ee41-6d92-4b08-989a-af1f2598fc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221727110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84091282-2dd5-4b43-871d-62c6fea21b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:47Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d348db95-7060-48f6-85b7-96a1ea58b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d348db95-7060-48f6-85b7-96a1ea58b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6fcb2e-e504-4982-9d3c-7b2a472d6117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6fcb2e-e504-4982-9d3c-7b2a472d6117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84091282-2dd5-4b43-871d-62c6fea21b96', 'volume_name': 'volume-84091282-2dd5-4b43-871d-62c6fea21b96', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddcc9d1-d6ce-4fb8-9947-b64d1c0f291a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddcc9d1-d6ce-4fb8-9947-b64d1c0f291a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb104950-236c-4b82-934d-3e782f9ebafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume 84091282-2dd5-4b43-871d-62c6fea21b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84091282-2dd5-4b43-871d-62c6fea21b96', 'volume_size': 1} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a634a827-c1c5-4c2d-af6a-946d5588cb87" returned: 0 in 1.223s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] <== create_volume: return (2277ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.288s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235432223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4acb54-3890-47be-b47d-95bb6f55bedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:48Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Creating volume fd4acb54-3890-47be-b47d-95bb6f55bedc {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:49 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fd4acb54-3890-47be-b47d-95bb6f55bedc 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:49 devstack quobyte-client[83739]: System call of process 99282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:47:49 devstack quobyte-client[83739]: System call of process 99282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:47:49 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=130, name=volume-fd4acb54-3890-47be-b47d-95bb6f55bedc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:49 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (7601ef57-1853-4138-a41e-ca1c01325204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04040508-713d-49a3-883b-e68b6d5db15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc933793-218f-47b5-86c4-4e72f9aac2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a634a827-c1c5-4c2d-af6a-946d5588cb87', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0bca14b-6d9f-494e-b53f-6befffcb1e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (14dfc043-a15b-436c-a16a-2dc54731eadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e411d3f-cb96-4cad-b90e-7e5efed089cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:49 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume volume-a634a827-c1c5-4c2d-af6a-946d5588cb87 (a634a827-c1c5-4c2d-af6a-946d5588cb87): created successfully Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0bca14b-6d9f-494e-b53f-6befffcb1e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (5e6f4837-c57f-41e1-8738-83bd4eaf989a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04040508-713d-49a3-883b-e68b6d5db15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918882389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff55b0b-404b-4f58-9b7b-428e5a8eec6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:48Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af8865a-1933-4a0f-b9a8-7e368d0ff45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af8865a-1933-4a0f-b9a8-7e368d0ff45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfbef28-1edc-464d-9d33-21119386bf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfbef28-1edc-464d-9d33-21119386bf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff55b0b-404b-4f58-9b7b-428e5a8eec6d', 'volume_name': 'volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7fce4d-77be-43f0-aeea-bb896ad365ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7fce4d-77be-43f0-aeea-bb896ad365ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0556ef-c889-4411-97ea-de75eecbd906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:50 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume aff55b0b-404b-4f58-9b7b-428e5a8eec6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d', 'volume_size': 1} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fd4acb54-3890-47be-b47d-95bb6f55bedc 1073741824" returned: 0 in 0.707s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fd4acb54-3890-47be-b47d-95bb6f55bedc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:50 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-bf727022-83a6-4035-909a-d01bd8dbdd4c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created volume successfully. Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e411d3f-cb96-4cad-b90e-7e5efed089cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-623604429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc83e955-9e6e-41bb-bc0b-ff87d74c464c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:49Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0527a5-972c-4cf1-a8be-48c5aced13cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0527a5-972c-4cf1-a8be-48c5aced13cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8492fa2-85ec-4aab-96ee-7c1e38d016bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8492fa2-85ec-4aab-96ee-7c1e38d016bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc83e955-9e6e-41bb-bc0b-ff87d74c464c', 'volume_name': 'volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29edb7b9-8ab6-489a-809f-9e5910c48a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29edb7b9-8ab6-489a-809f-9e5910c48a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0073d8ad-1674-4245-be99-1843ce2aa296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:50 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume cc83e955-9e6e-41bb-bc0b-ff87d74c464c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c', 'volume_size': 1} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fd4acb54-3890-47be-b47d-95bb6f55bedc" returned: 0 in 0.494s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] <== create_volume: return (1229ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221727110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84091282-2dd5-4b43-871d-62c6fea21b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:47Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Creating volume 84091282-2dd5-4b43-871d-62c6fea21b96 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:50 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84091282-2dd5-4b43-871d-62c6fea21b96 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:50 devstack quobyte-client[83739]: System call of process 99286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:47:50 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=131, name=volume-84091282-2dd5-4b43-871d-62c6fea21b96, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063ff029-457c-47b3-bca7-f11384b34330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4acb54-3890-47be-b47d-95bb6f55bedc', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e24fd8c-934b-436d-9f35-7c0bef791b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84091282-2dd5-4b43-871d-62c6fea21b96 1073741824" returned: 0 in 0.529s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84091282-2dd5-4b43-871d-62c6fea21b96 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:51 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume volume-fd4acb54-3890-47be-b47d-95bb6f55bedc (fd4acb54-3890-47be-b47d-95bb6f55bedc): created successfully Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e24fd8c-934b-436d-9f35-7c0bef791b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (94f1078b-b8fb-48b8-8f37-1abceaf6b1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84091282-2dd5-4b43-871d-62c6fea21b96" returned: 0 in 0.435s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] <== create_volume: return (991ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918882389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff55b0b-404b-4f58-9b7b-428e5a8eec6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:48Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Creating volume aff55b0b-404b-4f58-9b7b-428e5a8eec6d {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:51 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:51 devstack quobyte-client[83739]: System call of process 99290 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:47:51 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=132, name=volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:51 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-bffc7bec-b5a0-4b42-b9e6-f87041228c40 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created volume successfully. Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb104950-236c-4b82-934d-3e782f9ebafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84091282-2dd5-4b43-871d-62c6fea21b96', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d81f75-a338-4d0d-8382-db056b81ee56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d 1073741824" returned: 0 in 0.600s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:52 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume volume-84091282-2dd5-4b43-871d-62c6fea21b96 (84091282-2dd5-4b43-871d-62c6fea21b96): created successfully Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d81f75-a338-4d0d-8382-db056b81ee56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (bfd610f4-e8b3-4500-8b73-d19212493b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d" returned: 0 in 0.478s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] <== create_volume: return (1111ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.242s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-623604429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc83e955-9e6e-41bb-bc0b-ff87d74c464c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8439432ed4d64ccb863e19d65477630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:49Z,use_quota=True,user_id='07d33a4c7a2d45619c7a0c78d61eef09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Creating volume cc83e955-9e6e-41bb-bc0b-ff87d74c464c {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:52 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:52 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=133, name=volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:52 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-17476ab2-56fe-4779-9ea7-a90f73ef1105 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created volume successfully. Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0556ef-c889-4411-97ea-de75eecbd906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4730a1c-a988-412f-9b00-52967c878813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c 1073741824" returned: 0 in 0.446s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:53 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d (aff55b0b-404b-4f58-9b7b-428e5a8eec6d): created successfully Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4730a1c-a988-412f-9b00-52967c878813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (7601ef57-1853-4138-a41e-ca1c01325204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c" returned: 0 in 0.347s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] <== create_volume: return (825ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:53 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4583e6f4-ada4-432a-a093-4819e9306b2d tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created volume successfully. Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0073d8ad-1674-4245-be99-1843ce2aa296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4889fc99-3ad8-482f-a210-ae8bb0cd9fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:53 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c (cc83e955-9e6e-41bb-bc0b-ff87d74c464c): created successfully Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4889fc99-3ad8-482f-a210-ae8bb0cd9fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:53 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Flow 'volume_create_manager' (14dfc043-a15b-436c-a16a-2dc54731eadb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:53 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a9a9e7c6-b4cd-432d-b3b4-6fffbf57cf38 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created volume successfully. Sep 17 18:47:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-cc83e955-9e6e-41bb-bc0b-ff87d74c464c-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-cc83e955-9e6e-41bb-bc0b-ff87d74c464c-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:54 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-quobyte-cc83e955-9e6e-41bb-bc0b-ff87d74c464c" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:54 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-cc83e955-9e6e-41bb-bc0b-ff87d74c464c" acquired by "delete_volume" :: waited 0.017s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:54 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c1cc8-7863-4ce3-a203-ca27a66fb293]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:47:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c" returned: 0 in 0.494s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-cc83e955-9e6e-41bb-bc0b-ff87d74c464c" returned: 0 in 0.097s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-cc83e955-9e6e-41bb-bc0b-ff87d74c464c" released by "delete_volume" :: held 0.773s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:55 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created reservations ['da67eef5-a8a6-456f-b943-031cfd3f16e2', '90f7b451-079c-4e23-bdbc-5366a2490a1b', 'a8cbd9e8-da2f-48f2-858d-cc71089f5016', '2604585c-d254-4ba0-9898-0b85a592d446'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:47:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:55 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:55 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:55 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.178s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:56 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:47:56 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Deleted volume successfully. Sep 17 18:47:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-880d95a4-8b91-40f5-b551-37645fb9a4f4 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-cc83e955-9e6e-41bb-bc0b-ff87d74c464c-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-aff55b0b-404b-4f58-9b7b-428e5a8eec6d-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-aff55b0b-404b-4f58-9b7b-428e5a8eec6d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:56 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-quobyte-aff55b0b-404b-4f58-9b7b-428e5a8eec6d" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-aff55b0b-404b-4f58-9b7b-428e5a8eec6d" acquired by "delete_volume" :: waited 0.012s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:57 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd1e8a9-073e-4a31-8028-761ff5a7d894]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:47:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d" returned: 0 in 0.492s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-aff55b0b-404b-4f58-9b7b-428e5a8eec6d" returned: 0 in 0.113s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:57 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-aff55b0b-404b-4f58-9b7b-428e5a8eec6d" released by "delete_volume" :: held 0.842s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:58 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created reservations ['d6fb256b-c7ef-4bcc-b60f-d5053c62de64', 'f6b20cf9-eb7a-4935-818a-9ed5d36e76f9', 'a61af65c-3581-4804-b931-db5a8ca49350', '11604465-87cb-4e9c-be27-f591944b4e1c'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:47:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.140s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:58 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:47:58 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Deleted volume successfully. Sep 17 18:47:58 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-729fbb14-c429-49f4-a839-7110bddbb662 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-aff55b0b-404b-4f58-9b7b-428e5a8eec6d-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:47:58 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-fd4acb54-3890-47be-b47d-95bb6f55bedc-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-fd4acb54-3890-47be-b47d-95bb6f55bedc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:59 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (87a665fb-88fc-4616-8082-5224cdd88fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3001e36d-dfd6-4def-bd84-b2544ab76879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3001e36d-dfd6-4def-bd84-b2544ab76879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823888812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb8feaf-71bc-46a1-bcef-761eb235a507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:59Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a507b034-025e-4453-977b-1fdc5d86733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a507b034-025e-4453-977b-1fdc5d86733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa463f4-c55e-44ca-badb-0d3aad64f187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa463f4-c55e-44ca-badb-0d3aad64f187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb8feaf-71bc-46a1-bcef-761eb235a507', 'volume_name': 'volume-eeb8feaf-71bc-46a1-bcef-761eb235a507', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f18c51-ce84-4b32-98cf-9f48e63a8068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f18c51-ce84-4b32-98cf-9f48e63a8068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf302e0-bf34-409e-99b7-397eab9bd52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:47:59 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume eeb8feaf-71bc-46a1-bcef-761eb235a507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb8feaf-71bc-46a1-bcef-761eb235a507', 'volume_size': 1} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823888812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb8feaf-71bc-46a1-bcef-761eb235a507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:47:59Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Creating volume eeb8feaf-71bc-46a1-bcef-761eb235a507 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:47:59 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:59 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=134, name=volume-eeb8feaf-71bc-46a1-bcef-761eb235a507, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:47:59 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-quobyte-fd4acb54-3890-47be-b47d-95bb6f55bedc" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 1073741824" returned: 0 in 0.405s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-fd4acb54-3890-47be-b47d-95bb6f55bedc" acquired by "delete_volume" :: waited 0.183s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[40569d2f-6712-4da4-8c08-f25d8a896746]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fd4acb54-3890-47be-b47d-95bb6f55bedc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:47:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507" returned: 0 in 0.250s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:00 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] <== create_volume: return (713ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:48:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf302e0-bf34-409e-99b7-397eab9bd52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb8feaf-71bc-46a1-bcef-761eb235a507', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8113c6c6-ec9f-48e7-b400-40a349b51a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:00 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 (eeb8feaf-71bc-46a1-bcef-761eb235a507): created successfully Sep 17 18:48:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8113c6c6-ec9f-48e7-b400-40a349b51a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (87a665fb-88fc-4616-8082-5224cdd88fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:00 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a78f4358-6421-4db9-86ef-df534764e30c tempest-CreateVolumesFromSnapshotTest-885493643 None] Created volume successfully. Sep 17 18:48:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fd4acb54-3890-47be-b47d-95bb6f55bedc" returned: 0 in 0.541s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fd4acb54-3890-47be-b47d-95bb6f55bedc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-fd4acb54-3890-47be-b47d-95bb6f55bedc" returned: 0 in 0.089s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:00 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-fd4acb54-3890-47be-b47d-95bb6f55bedc" released by "delete_volume" :: held 0.830s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:00 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created reservations ['490890e7-6150-4b6e-8ab9-b6f185f3d8cb', '59da9d3c-8e88-4100-9175-481a27e23562', 'afc02e69-40de-4abe-9d06-e3d75d88d8cd', '35836bb8-7aea-442a-bb3e-d3f9a8147878'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.106s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:01 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:01 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Deleted volume successfully. Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-84091282-2dd5-4b43-871d-62c6fea21b96-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-84091282-2dd5-4b43-871d-62c6fea21b96-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-31873bda-1660-4603-919c-79c6b2cf91f1 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-fd4acb54-3890-47be-b47d-95bb6f55bedc-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:02 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-quobyte-84091282-2dd5-4b43-871d-62c6fea21b96" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-84091282-2dd5-4b43-871d-62c6fea21b96" acquired by "delete_volume" :: waited 0.013s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:02 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[28414324-b1af-4603-b95e-ae0eb0f19c78]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84091282-2dd5-4b43-871d-62c6fea21b96 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Creating offline snapshot e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 of volume eeb8feaf-71bc-46a1-bcef-761eb235a507 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[242adaf6-44e6-48ee-a990-ca7408e810ac]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84091282-2dd5-4b43-871d-62c6fea21b96" returned: 0 in 0.545s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84091282-2dd5-4b43-871d-62c6fea21b96 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-84091282-2dd5-4b43-871d-62c6fea21b96" returned: 0 in 0.095s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-84091282-2dd5-4b43-871d-62c6fea21b96" released by "delete_volume" :: held 0.825s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507" returned: 0 in 0.644s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:03 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=135, name=volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:48:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 1G" returned: 0 in 0.319s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): qemu-img rebase -u -b volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "qemu-img rebase -u -b volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250" returned: 0 in 0.205s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:03 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:48:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:04 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created reservations ['014bf9c3-3de8-4977-bf52-34faa7b5c53c', '3af2cf40-26c3-403e-856f-0061e2fbd067', '4f24a427-97c9-4a27-91fe-eab9107a1cab', '66622e85-9cf4-42dd-9da4-770f4bdb6c5e'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250" returned: 0 in 0.270s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:48:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250" returned: 0 in 0.309s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.info" returned: 0 in 0.222s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:48:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.info" returned: 0 in 0.186s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:05 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-13718258-efc7-4e1d-a8b8-ad18a23e8c93 tempest-CreateVolumesFromSnapshotTest-885493643 None] Create snapshot completed successfully Sep 17 18:48:05 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-a634a827-c1c5-4c2d-af6a-946d5588cb87-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.560s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:06 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Deleted volume successfully. Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-a634a827-c1c5-4c2d-af6a-946d5588cb87-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=76,cinder:UPDATE=79,cinder:DELETE=12,cinder:INSERT=26 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-37cbd1c0-c208-4d0d-a8f6-4997aa228c8c tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-84091282-2dd5-4b43-871d-62c6fea21b96-delete_volume" released by "delete_volume" :: held 3.973s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:06 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-quobyte-a634a827-c1c5-4c2d-af6a-946d5588cb87" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-a634a827-c1c5-4c2d-af6a-946d5588cb87" acquired by "delete_volume" :: waited 0.044s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:06 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (f77629bf-d1c4-4523-a899-d30f0f7611f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99844584-9a5b-4f21-a495-19cb6c6dc1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1c12dc-9d2d-42e8-ab7d-a68f367feef3]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a634a827-c1c5-4c2d-af6a-946d5588cb87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:06 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=68,cinder:UPDATE=150,cinder:DELETE=12,cinder:INSERT=18 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99844584-9a5b-4f21-a495-19cb6c6dc1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1401997249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5888c176-bb2b-4132-9eb2-70720f02dff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:06Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4ebea9-b94e-4a87-af69-67b234ea4843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4ebea9-b94e-4a87-af69-67b234ea4843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d13ee31-f8eb-4eba-a533-fe3b3d6ebebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d13ee31-f8eb-4eba-a533-fe3b3d6ebebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5888c176-bb2b-4132-9eb2-70720f02dff4', 'volume_name': 'volume-5888c176-bb2b-4132-9eb2-70720f02dff4', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4848e64-6560-4360-8259-fee61bd4a18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4848e64-6560-4360-8259-fee61bd4a18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2db433b-9d92-4518-9557-8592f4d9a32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:07 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume 5888c176-bb2b-4132-9eb2-70720f02dff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5888c176-bb2b-4132-9eb2-70720f02dff4', 'volume_size': 1} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1401997249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5888c176-bb2b-4132-9eb2-70720f02dff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:06Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Creating volume 5888c176-bb2b-4132-9eb2-70720f02dff4 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:48:07 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5888c176-bb2b-4132-9eb2-70720f02dff4 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:07 devstack quobyte-client[83739]: System call of process 99347 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:48:07 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=137, name=volume-5888c176-bb2b-4132-9eb2-70720f02dff4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:48:07 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (9c9dea8b-5203-4c6c-9a27-be10260d8457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:07 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f3f36c-6e7f-4069-ac99-7c50aa551ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a634a827-c1c5-4c2d-af6a-946d5588cb87" returned: 0 in 1.593s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f3f36c-6e7f-4069-ac99-7c50aa551ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1629317049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b40024-f713-4aea-8cd3-242739a96b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:07Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980f3023-74fa-40df-b851-315607cb8a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980f3023-74fa-40df-b851-315607cb8a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b862c1a7-d340-470b-9fd4-a0aa6d1ea655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b862c1a7-d340-470b-9fd4-a0aa6d1ea655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b40024-f713-4aea-8cd3-242739a96b5c', 'volume_name': 'volume-50b40024-f713-4aea-8cd3-242739a96b5c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88db648-0cb7-4899-9d27-02c96e46ad37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88db648-0cb7-4899-9d27-02c96e46ad37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840ad8d8-82ea-4271-ae49-d17651682abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:08 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume 50b40024-f713-4aea-8cd3-242739a96b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b40024-f713-4aea-8cd3-242739a96b5c', 'volume_size': 1} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a634a827-c1c5-4c2d-af6a-946d5588cb87 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5888c176-bb2b-4132-9eb2-70720f02dff4 1073741824" returned: 0 in 1.209s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:08 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (2c60deab-0c73-46cc-a0f3-f31c13ea566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8b0930-c92a-453f-a456-3e47ce632302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5888c176-bb2b-4132-9eb2-70720f02dff4 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8b0930-c92a-453f-a456-3e47ce632302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1767178745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6854c0dd-5080-4647-acbf-539d15943117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:07Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a299e29f-0ec4-4b5c-bbaa-9562c52ca5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a299e29f-0ec4-4b5c-bbaa-9562c52ca5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8450b1-9cb7-4f33-a069-67690c28d98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8450b1-9cb7-4f33-a069-67690c28d98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6854c0dd-5080-4647-acbf-539d15943117', 'volume_name': 'volume-6854c0dd-5080-4647-acbf-539d15943117', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ae44fa-e04e-4c87-aa3b-ab76ee7756ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ae44fa-e04e-4c87-aa3b-ab76ee7756ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1d45ce-ea25-4d97-9223-22ff06b86dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:08 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume 6854c0dd-5080-4647-acbf-539d15943117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6854c0dd-5080-4647-acbf-539d15943117', 'volume_size': 1} Sep 17 18:48:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a634a827-c1c5-4c2d-af6a-946d5588cb87" returned: 0 in 0.942s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:09 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (6ee54fc3-1010-4303-8988-77ce04698740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df31ac57-9eba-4931-8e35-2971cff30c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-a634a827-c1c5-4c2d-af6a-946d5588cb87" released by "delete_volume" :: held 2.945s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5888c176-bb2b-4132-9eb2-70720f02dff4" returned: 0 in 0.584s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] <== create_volume: return (2075ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.162s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1629317049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b40024-f713-4aea-8cd3-242739a96b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:07Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Creating volume 50b40024-f713-4aea-8cd3-242739a96b5c {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:48:09 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-50b40024-f713-4aea-8cd3-242739a96b5c 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:09 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:48:09 devstack quobyte-client[83739]: System call of process 99352 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:48:09 devstack quobyte-client[83739]: System call of process 99352 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:48:09 devstack quobyte-client[83739]: System call of process 99352 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:48:09 devstack quobyte-client[83739]: System call of process 99352 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:48:09 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=138, name=volume-50b40024-f713-4aea-8cd3-242739a96b5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (ce14b36a-19d4-4fdc-affa-d39019a9f7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a3ecb4-dfbd-48f8-8176-100d2d825959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df31ac57-9eba-4931-8e35-2971cff30c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532103049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cf5896-dd0b-4139-ab96-d0a36dbec419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:08Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5fb3d2-0705-4720-a6f1-fd2ba1c54d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5fb3d2-0705-4720-a6f1-fd2ba1c54d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce9353e-17a4-4c70-a34e-24dc72834597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce9353e-17a4-4c70-a34e-24dc72834597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2cf5896-dd0b-4139-ab96-d0a36dbec419', 'volume_name': 'volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63655ea8-4d4f-485c-8732-d9ec13eef5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63655ea8-4d4f-485c-8732-d9ec13eef5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e4d0a7-92da-4201-9c3d-07951bb7ca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:09 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume c2cf5896-dd0b-4139-ab96-d0a36dbec419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419', 'volume_size': 1} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2db433b-9d92-4518-9557-8592f4d9a32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5888c176-bb2b-4132-9eb2-70720f02dff4', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19856477-ab23-467e-9957-b85d0464d80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a3ecb4-dfbd-48f8-8176-100d2d825959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002590896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662c65bd-ecb7-4386-9653-1ade999fc75d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:08Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ca8dbf-9943-427a-a0c4-ef5a93699de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ca8dbf-9943-427a-a0c4-ef5a93699de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db35e88-ee35-4fd8-8884-a032d6e91669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db35e88-ee35-4fd8-8884-a032d6e91669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662c65bd-ecb7-4386-9653-1ade999fc75d', 'volume_name': 'volume-662c65bd-ecb7-4386-9653-1ade999fc75d', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e4ed4a-c6c8-466e-827c-8d0776003e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e4ed4a-c6c8-466e-827c-8d0776003e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96561347-16ec-469c-927d-665fc7b4ed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:09 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume 662c65bd-ecb7-4386-9653-1ade999fc75d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662c65bd-ecb7-4386-9653-1ade999fc75d', 'volume_size': 1} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:09 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume volume-5888c176-bb2b-4132-9eb2-70720f02dff4 (5888c176-bb2b-4132-9eb2-70720f02dff4): created successfully Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19856477-ab23-467e-9957-b85d0464d80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (f77629bf-d1c4-4523-a899-d30f0f7611f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-50b40024-f713-4aea-8cd3-242739a96b5c 1073741824" returned: 0 in 0.676s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-50b40024-f713-4aea-8cd3-242739a96b5c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:10 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a891549f-96ae-4862-9832-ab5006875fb3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Created volume successfully. Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-50b40024-f713-4aea-8cd3-242739a96b5c" returned: 0 in 0.325s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] <== create_volume: return (1022ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1767178745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6854c0dd-5080-4647-acbf-539d15943117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:07Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Creating volume 6854c0dd-5080-4647-acbf-539d15943117 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:48:10 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6854c0dd-5080-4647-acbf-539d15943117 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:10 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=139, name=volume-6854c0dd-5080-4647-acbf-539d15943117, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created reservations ['d9d3620b-5433-41c1-ae2f-6dc4529791f4', '8ffeca7d-c289-4bb2-8061-7d9fbf380628', 'cd0a9a85-f8c9-4599-bfa2-058aadecc0d5', '59ce5249-5881-4b7e-a20c-ad5344731b2e'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840ad8d8-82ea-4271-ae49-d17651682abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b40024-f713-4aea-8cd3-242739a96b5c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bd4179-bbdb-4bb8-be23-7113c7dad504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6854c0dd-5080-4647-acbf-539d15943117 1073741824" returned: 0 in 0.560s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6854c0dd-5080-4647-acbf-539d15943117 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:11 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume volume-50b40024-f713-4aea-8cd3-242739a96b5c (50b40024-f713-4aea-8cd3-242739a96b5c): created successfully Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bd4179-bbdb-4bb8-be23-7113c7dad504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (9c9dea8b-5203-4c6c-9a27-be10260d8457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-8c2b10b4-0a73-4f6f-a85d-affbf1873a53-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6854c0dd-5080-4647-acbf-539d15943117" returned: 0 in 0.675s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:11 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1f6a892c-a47b-4efa-9580-80222cca6801 tempest-CreateVolumesFromSnapshotTest-885493643 None] Created volume successfully. Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] <== create_volume: return (1285ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532103049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cf5896-dd0b-4139-ab96-d0a36dbec419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:08Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Creating volume c2cf5896-dd0b-4139-ab96-d0a36dbec419 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:48:11 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:11 devstack quobyte-client[83739]: System call of process 99361 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:48:11 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=140, name=volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.726s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:11 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:12 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Deleted volume successfully. Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-8c2b10b4-0a73-4f6f-a85d-affbf1873a53-delete_volume" acquired by "delete_volume" :: waited 0.548s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1d45ce-ea25-4d97-9223-22ff06b86dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6854c0dd-5080-4647-acbf-539d15943117', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14b2210-fafe-49d0-a4b1-7ec0ed02c2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419 1073741824" returned: 0 in 0.593s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:12 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume volume-6854c0dd-5080-4647-acbf-539d15943117 (6854c0dd-5080-4647-acbf-539d15943117): created successfully Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14b2210-fafe-49d0-a4b1-7ec0ed02c2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (2c60deab-0c73-46cc-a0f3-f31c13ea566d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-cc0c28a0-39f8-4562-88f1-5c4f07681212 tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-a634a827-c1c5-4c2d-af6a-946d5588cb87-delete_volume" released by "delete_volume" :: held 6.578s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:12 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-10329954-c813-4a5a-91a8-386ff306f50d tempest-CreateVolumesFromSnapshotTest-885493643 None] Created volume successfully. Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419" returned: 0 in 0.443s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] <== create_volume: return (1101ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.836s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002590896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662c65bd-ecb7-4386-9653-1ade999fc75d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eed7afe57474087a59527158f95b0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:08Z,use_quota=True,user_id='7a01753b6f4b4488ba3e184df76420b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Creating volume 662c65bd-ecb7-4386-9653-1ade999fc75d {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:48:12 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-662c65bd-ecb7-4386-9653-1ade999fc75d 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:12 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=141, name=volume-662c65bd-ecb7-4386-9653-1ade999fc75d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:48:12 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "cinder-quobyte-8c2b10b4-0a73-4f6f-a85d-affbf1873a53" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e4d0a7-92da-4201-9c3d-07951bb7ca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9f3d8f-b1c7-4edd-8e54-c6fcea2a9a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:13 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419 (c2cf5896-dd0b-4139-ab96-d0a36dbec419): created successfully Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9f3d8f-b1c7-4edd-8e54-c6fcea2a9a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (6ee54fc3-1010-4303-8988-77ce04698740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-8c2b10b4-0a73-4f6f-a85d-affbf1873a53" acquired by "delete_volume" :: waited 0.344s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-662c65bd-ecb7-4386-9653-1ade999fc75d 1073741824" returned: 0 in 0.548s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:13 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-58cc2425-b0f6-404b-8a81-ca87f35a86f4 tempest-CreateVolumesFromSnapshotTest-885493643 None] Created volume successfully. Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-662c65bd-ecb7-4386-9653-1ade999fc75d {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd54600a-b0ab-47f5-b786-380e7fe62e42]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-662c65bd-ecb7-4386-9653-1ade999fc75d" returned: 0 in 0.370s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] <== create_volume: return (965ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96561347-16ec-469c-927d-665fc7b4ed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662c65bd-ecb7-4386-9653-1ade999fc75d', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626bc134-763f-48ca-8586-b7de97945148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:13 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume volume-662c65bd-ecb7-4386-9653-1ade999fc75d (662c65bd-ecb7-4386-9653-1ade999fc75d): created successfully Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626bc134-763f-48ca-8586-b7de97945148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:13 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Flow 'volume_create_manager' (ce14b36a-19d4-4fdc-affa-d39019a9f7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:14 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ece32db2-e10a-40bd-980c-3a56124d0615 tempest-CreateVolumesFromSnapshotTest-885493643 None] Created volume successfully. Sep 17 18:48:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53" returned: 0 in 0.541s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8c2b10b4-0a73-4f6f-a85d-affbf1873a53" returned: 0 in 0.091s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-quobyte-8c2b10b4-0a73-4f6f-a85d-affbf1873a53" released by "delete_volume" :: held 1.010s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-662c65bd-ecb7-4386-9653-1ade999fc75d-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-662c65bd-ecb7-4386-9653-1ade999fc75d-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:14 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Created reservations ['429837fe-ffce-4372-a0b0-523a61a0eee1', '064f70f7-c887-4ac1-8cb2-5c12f983c67b', 'ad936fe0-79ca-41de-871a-cff48796a75d', 'f2c544fb-b9bf-492f-aea1-fb0fde8e7ea7'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:14 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-quobyte-662c65bd-ecb7-4386-9653-1ade999fc75d" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-662c65bd-ecb7-4386-9653-1ade999fc75d" acquired by "delete_volume" :: waited 0.015s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:14 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e71bfb9-6bdb-454c-81dc-60f1d1f05138]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-662c65bd-ecb7-4386-9653-1ade999fc75d {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.115s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:15 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Deleted volume successfully. Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-662c65bd-ecb7-4386-9653-1ade999fc75d" returned: 0 in 0.600s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-662c65bd-ecb7-4386-9653-1ade999fc75d {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6df94b47-786f-4866-8a2c-cbd4bf46afcb tempest-CreateVolumesFromSourceVolumeTest-399311359 None] Lock "cinder-8c2b10b4-0a73-4f6f-a85d-affbf1873a53-delete_volume" released by "delete_volume" :: held 3.679s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-662c65bd-ecb7-4386-9653-1ade999fc75d" returned: 0 in 0.268s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-662c65bd-ecb7-4386-9653-1ade999fc75d" released by "delete_volume" :: held 0.923s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Created reservations ['a7f3eeb9-3faa-4b02-8b67-dec885dd714a', '971a0fb1-54e5-4433-803f-72b5c9318558', '8be4cd9a-6115-44ad-b87a-d116ba694ef3', '97460217-f86a-4f8c-8ecf-5df8864f8938'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.094s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:16 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Deleted volume successfully. Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fd0cc3f4-e8b6-4e3d-af8e-35d154e083a3 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-662c65bd-ecb7-4386-9653-1ade999fc75d-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-c2cf5896-dd0b-4139-ab96-d0a36dbec419-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:16 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-c2cf5896-dd0b-4139-ab96-d0a36dbec419-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:17 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-quobyte-c2cf5896-dd0b-4139-ab96-d0a36dbec419" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.248s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-c2cf5896-dd0b-4139-ab96-d0a36dbec419" acquired by "delete_volume" :: waited 0.170s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3fa0a3-3e7c-4cc8-a299-b46e0f161b82]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419" returned: 0 in 0.507s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c2cf5896-dd0b-4139-ab96-d0a36dbec419" returned: 0 in 0.102s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-c2cf5896-dd0b-4139-ab96-d0a36dbec419" released by "delete_volume" :: held 0.830s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:18 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Created reservations ['b0b76c0d-0c4b-4030-9b0f-4cfcb92e7e13', '5f3eb930-3e6e-4780-a287-02fbbcc7381f', 'e865b02d-e68f-4347-820a-5c77b37df970', 'e47c5080-79e0-4a14-af95-47e85c6641e1'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.105s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:19 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Deleted volume successfully. Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-6854c0dd-5080-4647-acbf-539d15943117-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-6854c0dd-5080-4647-acbf-539d15943117-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-493b08da-b1d1-47ba-a5e9-e5c25fee97d6 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-c2cf5896-dd0b-4139-ab96-d0a36dbec419-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:19 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-quobyte-6854c0dd-5080-4647-acbf-539d15943117" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-6854c0dd-5080-4647-acbf-539d15943117" acquired by "delete_volume" :: waited 0.010s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e65be54-3cb6-4124-a270-8b4dd4b67810]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6854c0dd-5080-4647-acbf-539d15943117 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6854c0dd-5080-4647-acbf-539d15943117" returned: 0 in 0.642s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6854c0dd-5080-4647-acbf-539d15943117 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:20 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Flow 'volume_create_manager' (b0f24644-8735-444a-8f34-7bc07673757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24e3703-eb7b-4891-8f29-98fc2efe703b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24e3703-eb7b-4891-8f29-98fc2efe703b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000ecaa1-71e4-45ef-a3ea-d8980c9625f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fdc0e82b024c7ea41fcd9959e09d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:20Z,use_quota=True,user_id='be90ebaab42d4e3886802bde64d02108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e7fdeb-0643-40bb-99b5-bbacc9f4d50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e7fdeb-0643-40bb-99b5-bbacc9f4d50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eafa8ae-159d-4b07-ba7d-d5bd76088342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eafa8ae-159d-4b07-ba7d-d5bd76088342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '000ecaa1-71e4-45ef-a3ea-d8980c9625f3', 'volume_name': 'volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9601969d-5841-442d-a298-acee1b6d3c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9601969d-5841-442d-a298-acee1b6d3c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedd5cd7-0fbe-42f1-a875-17a7a0c4b33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:20 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Volume 000ecaa1-71e4-45ef-a3ea-d8980c9625f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3', 'volume_size': 1} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000ecaa1-71e4-45ef-a3ea-d8980c9625f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fdc0e82b024c7ea41fcd9959e09d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:20Z,use_quota=True,user_id='be90ebaab42d4e3886802bde64d02108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Creating volume 000ecaa1-71e4-45ef-a3ea-d8980c9625f3 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:48:20 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:48:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6854c0dd-5080-4647-acbf-539d15943117" returned: 0 in 0.628s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:21 devstack quobyte-client[83739]: System call of process 99390 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:48:21 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=142, name=volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-6854c0dd-5080-4647-acbf-539d15943117" released by "delete_volume" :: held 1.511s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3 1073741824" returned: 0 in 0.465s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3" returned: 0 in 0.265s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] <== create_volume: return (775ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Created reservations ['f5caa915-7eb0-435c-9d78-edb355d3df97', '45ddc6a9-6d75-4e76-b1cb-9c6dfd05fefa', '514eead3-753e-42c5-8ef8-61d3525c4bec', '3397dbc7-30ec-4770-ab87-7f76aaf3a6b9'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedd5cd7-0fbe-42f1-a875-17a7a0c4b33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d49635-2cc4-45f2-939c-4b20be96fcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:21 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Volume volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3 (000ecaa1-71e4-45ef-a3ea-d8980c9625f3): created successfully Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d49635-2cc4-45f2-939c-4b20be96fcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:21 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Flow 'volume_create_manager' (b0f24644-8735-444a-8f34-7bc07673757e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:22 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-13a4528c-d026-45d6-bc09-7d3c13434ebc tempest-CinderUnicodeTest-1151869939 None] Created volume successfully. Sep 17 18:48:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:22 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.145s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:22 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:22 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Deleted volume successfully. Sep 17 18:48:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-ece56c09-3972-49ef-8189-1be922e76d00 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-6854c0dd-5080-4647-acbf-539d15943117-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-50b40024-f713-4aea-8cd3-242739a96b5c-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-50b40024-f713-4aea-8cd3-242739a96b5c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:23 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-quobyte-50b40024-f713-4aea-8cd3-242739a96b5c" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-50b40024-f713-4aea-8cd3-242739a96b5c" acquired by "delete_volume" :: waited 0.053s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac63b6af-cde4-4b1a-b53a-11023abe5ea4]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-50b40024-f713-4aea-8cd3-242739a96b5c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:23 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Flow 'volume_create_manager' (8e8b9cad-429b-4288-bf79-36408e6871cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06c0001-5919-44f1-b2e7-0ea34695e299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:23 devstack quobyte-client[83739]: System call of process 99409 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06c0001-5919-44f1-b2e7-0ea34695e299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-196127422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8c28e3-39aa-453a-b7b4-afc97a1c9a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fdc0e82b024c7ea41fcd9959e09d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:23Z,use_quota=True,user_id='be90ebaab42d4e3886802bde64d02108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c92718-c9a5-4995-b527-04828b6d0234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c92718-c9a5-4995-b527-04828b6d0234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8b4f23-9392-40c7-924c-283ea058a92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8b4f23-9392-40c7-924c-283ea058a92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8c28e3-39aa-453a-b7b4-afc97a1c9a85', 'volume_name': 'volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f6b4ea-2cce-4ce4-854d-4ff9c2298514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f6b4ea-2cce-4ce4-854d-4ff9c2298514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee9affe-e457-491f-8cd0-d5bbd7181e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:23 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Volume 3b8c28e3-39aa-453a-b7b4-afc97a1c9a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85', 'volume_size': 1} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-196127422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8c28e3-39aa-453a-b7b4-afc97a1c9a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fdc0e82b024c7ea41fcd9959e09d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:23Z,use_quota=True,user_id='be90ebaab42d4e3886802bde64d02108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Creating volume 3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:48:23 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:48:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-50b40024-f713-4aea-8cd3-242739a96b5c" returned: 0 in 1.045s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-50b40024-f713-4aea-8cd3-242739a96b5c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:24 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=143, name=volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:48:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-50b40024-f713-4aea-8cd3-242739a96b5c" returned: 0 in 0.144s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:24 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-50b40024-f713-4aea-8cd3-242739a96b5c" released by "delete_volume" :: held 1.469s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 1073741824" returned: 0 in 0.778s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85" returned: 0 in 0.291s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] <== create_volume: return (1116ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee9affe-e457-491f-8cd0-d5bbd7181e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21d46e7-d70a-4b3f-ac0b-4790ec9db215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:25 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Volume volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 (3b8c28e3-39aa-453a-b7b4-afc97a1c9a85): created successfully Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21d46e7-d70a-4b3f-ac0b-4790ec9db215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Flow 'volume_create_manager' (8e8b9cad-429b-4288-bf79-36408e6871cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:25 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1facdae8-679a-4bc7-abb7-748f078c0767 tempest-CinderUnicodeTest-1151869939 None] Created volume successfully. Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Created reservations ['99768d83-1994-4ac8-b845-2771537cef5c', 'e86a2477-3d96-4bef-8e92-6bfd11cd477c', 'aae946bc-2c6d-459d-9833-d04441321977', '3206ee2b-3471-4132-89f4-64ae7eeb16a9'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.093s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:25 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Deleted volume successfully. Sep 17 18:48:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2be5b0bd-7e19-4981-9e30-da8c4cc11d6a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-50b40024-f713-4aea-8cd3-242739a96b5c-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-5888c176-bb2b-4132-9eb2-70720f02dff4-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-5888c176-bb2b-4132-9eb2-70720f02dff4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:26 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-quobyte-5888c176-bb2b-4132-9eb2-70720f02dff4" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:26 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-5888c176-bb2b-4132-9eb2-70720f02dff4" acquired by "delete_volume" :: waited 0.014s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:26 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5ca95f-b6b4-41ee-85ab-ebe61f543f28]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5888c176-bb2b-4132-9eb2-70720f02dff4 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:27 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Creating offline snapshot 0e6671d7-a44e-43ec-998c-dbe085b56bf2 of volume 3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:48:27 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a9c2ff-9f47-468c-b73a-1b2d11fc243c]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5888c176-bb2b-4132-9eb2-70720f02dff4" returned: 0 in 0.609s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5888c176-bb2b-4132-9eb2-70720f02dff4 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5888c176-bb2b-4132-9eb2-70720f02dff4" returned: 0 in 0.115s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:27 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-5888c176-bb2b-4132-9eb2-70720f02dff4" released by "delete_volume" :: held 0.970s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85" returned: 0 in 0.663s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:28 devstack quobyte-client[83739]: System call of process 99450 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:48:28 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=144, name=volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:48:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2 1G" returned: 0 in 0.315s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] CMD "qemu-img rebase -u -b volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2" returned: 0 in 0.272s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:48:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2" returned: 0 in 0.191s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:48:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2" returned: 0 in 0.158s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Created reservations ['ab3ac3bd-88d4-4929-84d5-2268d262a17b', 'f43f5156-3566-48cf-9e55-cb7a32d278aa', '4863c3c5-1c3c-4930-8026-358246ad8895', 'd8bb8e8f-9db1-4558-b115-c78407ca58d1'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.info" returned: 0 in 0.263s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.info" returned: 0 in 0.209s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:29 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-20db0998-cb60-4d3c-9538-7f5c24bcb540 tempest-CinderUnicodeTest-1151869939 None] Create snapshot completed successfully Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.112s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:29 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:30 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Deleted volume successfully. Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "cinder-0e6671d7-a44e-43ec-998c-dbe085b56bf2-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-48d5c1bf-6731-45b5-b19f-27529d268184 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-5888c176-bb2b-4132-9eb2-70720f02dff4-delete_volume" released by "delete_volume" :: held 3.903s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250-delete_snapshot" acquired by "delete_snapshot" :: waited 0.102s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:30 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-quobyte-eeb8feaf-71bc-46a1-bcef-761eb235a507" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-0e6671d7-a44e-43ec-998c-dbe085b56bf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:30 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "cinder-quobyte-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-eeb8feaf-71bc-46a1-bcef-761eb235a507" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-quobyte-e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-quobyte-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "cinder-quobyte-0e6671d7-a44e-43ec-998c-dbe085b56bf2" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Deleting offline snapshot e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 of volume eeb8feaf-71bc-46a1-bcef-761eb235a507 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] snapshot_file for this snap is: volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-quobyte-0e6671d7-a44e-43ec-998c-dbe085b56bf2" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Deleting offline snapshot 0e6671d7-a44e-43ec-998c-dbe085b56bf2 of volume 3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] snapshot_file for this snap is: volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5137d756-3c44-431d-9be5-ebcd69053405]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28e6817-8ae8-4601-b102-614b152f75eb]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250" returned: 0 in 0.456s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eeb8feaf-71bc-46a1-bcef-761eb235a507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:48:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2" returned: 0 in 0.525s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:48:31 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e63f6a1-0ca2-4ed8-aa0b-a5d5f0be8dba]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:31 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7b57ab-e2fa-4ad6-8d9d-8900a9520537]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507" returned: 0 in 0.471s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85" returned: 0 in 0.548s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250" returned: 0 in 0.335s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2" returned: 0 in 0.288s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507.e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250" returned: 0 in 0.206s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85.0e6671d7-a44e-43ec-998c-dbe085b56bf2" returned: 0 in 0.187s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250" released by "_delete_snapshot" :: held 1.911s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-quobyte-0e6671d7-a44e-43ec-998c-dbe085b56bf2" released by "_delete_snapshot" :: held 1.898s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-eeb8feaf-71bc-46a1-bcef-761eb235a507" released by "delete_snapshot" :: held 1.949s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-quobyte-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85" released by "delete_snapshot" :: held 2.126s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Created reservations ['2873032b-3dc4-418f-9505-cc6cdbbc7b45', '9782bcdf-6bd6-4a7b-98fb-cb2d6b69daac', '14c056d4-6bd5-4d45-9287-243b2a4a69f2', 'b17b7d2c-af83-4aee-9af9-a768cc603ea3'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:32 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Created reservations ['110f0cd2-bdf4-47e5-b373-85292397013a', 'a67fd058-152d-4b63-8944-f83ab5db415d', '016f005c-0ffc-44f6-adab-799fd8e90adc', '7842774d-b610-4fc6-98a1-1822af191e3f'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:33 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Delete snapshot completed successfully. Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-544a1b3d-56ce-4740-8e68-9827bab0e983 tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-e5e0447f-4b35-4d1c-bb6a-8d99fdbb8250-delete_snapshot" released by "delete_snapshot" :: held 2.696s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:33 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Delete snapshot completed successfully. Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1ecbf2a9-13c6-42bf-b79f-56d3eaa20ea1 tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-0e6671d7-a44e-43ec-998c-dbe085b56bf2-delete_snapshot" released by "delete_snapshot" :: held 2.706s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-eeb8feaf-71bc-46a1-bcef-761eb235a507-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-eeb8feaf-71bc-46a1-bcef-761eb235a507-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "cinder-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "cinder-quobyte-eeb8feaf-71bc-46a1-bcef-761eb235a507" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "cinder-quobyte-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-eeb8feaf-71bc-46a1-bcef-761eb235a507" acquired by "delete_volume" :: waited 0.025s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7b370c-0f59-4144-8712-e52844da43bd]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-quobyte-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85" acquired by "delete_volume" :: waited 0.158s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0553f24d-8373-4274-b477-b075eb85c508]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507" returned: 0 in 0.491s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-eeb8feaf-71bc-46a1-bcef-761eb235a507" returned: 0 in 0.096s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:34 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-quobyte-eeb8feaf-71bc-46a1-bcef-761eb235a507" released by "delete_volume" :: held 0.818s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85" returned: 0 in 0.740s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:34 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Created reservations ['d238acef-8e23-4565-b8be-e4f6c2ccd3fe', 'ce477673-8a2e-497b-8f9d-8411948bd189', 'e66e95d7-7717-4a36-8243-f05bba516d60', '6017d1ad-8faa-4ff7-8f14-754e475938d6'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85" returned: 0 in 0.357s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:34 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-quobyte-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85" released by "delete_volume" :: held 1.325s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.294s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Deleted volume successfully. Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-856eba24-ae2c-45b1-996f-98008eccd35a tempest-CreateVolumesFromSnapshotTest-885493643 None] Lock "cinder-eeb8feaf-71bc-46a1-bcef-761eb235a507-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Created reservations ['2dd4b896-918d-4f60-ba9b-c9ef43d4330d', '4e0145f0-06bf-4c4a-a20a-d1ef280ad671', '479af738-ddb9-4240-aa23-f46625812c69', 'fa8fbc7d-acf1-49b1-9e0f-ffd6177cc20e'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.101s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:35 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Deleted volume successfully. Sep 17 18:48:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-6e8ce1eb-fd7d-48b2-adbb-65b0a88d9193 tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-3b8c28e3-39aa-453a-b7b4-afc97a1c9a85-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "cinder-000ecaa1-71e4-45ef-a3ea-d8980c9625f3-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-000ecaa1-71e4-45ef-a3ea-d8980c9625f3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:37 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "cinder-quobyte-000ecaa1-71e4-45ef-a3ea-d8980c9625f3" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:48:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-quobyte-000ecaa1-71e4-45ef-a3ea-d8980c9625f3" acquired by "delete_volume" :: waited 0.012s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:48:37 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[764723fd-9da5-48c5-be83-ec2b11025f84]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:48:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3" returned: 0 in 0.500s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-000ecaa1-71e4-45ef-a3ea-d8980c9625f3" returned: 0 in 0.100s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-quobyte-000ecaa1-71e4-45ef-a3ea-d8980c9625f3" released by "delete_volume" :: held 0.787s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:38 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Created reservations ['74be7c09-eb07-40a8-abff-cc6478aec5b4', 'fdf6371c-2f97-4e96-b354-d6a820a76b92', 'a9babfba-b5f2-4f4c-8a84-24b23502f5f2', '2c488af3-0218-40e3-a89c-b0fb305ccddf'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:48:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.085s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:38 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:48:38 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Deleted volume successfully. Sep 17 18:48:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-db0ba221-d915-4bb1-9a3f-f312a1e31ebe tempest-CinderUnicodeTest-1151869939 None] Lock "cinder-000ecaa1-71e4-45ef-a3ea-d8980c9625f3-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:48:48 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=63,cinder:UPDATE=103,cinder:INSERT=34,cinder:DELETE=8 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:48:48 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=68,cinder:UPDATE=107,cinder:DELETE=10,cinder:INSERT=14 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:48:56 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:56 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Flow 'volume_create_manager' (c2f907ce-7a1f-40d1-934a-08190dd9f5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa8f0c2-5684-4c4b-ba70-8085c618c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa8f0c2-5684-4c4b-ba70-8085c618c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554302493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942473ab-97d4-46df-9861-d72ba5ad38ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9048d0d167a046ddbe2dd06f7351c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:57Z,use_quota=True,user_id='70ff0c0885c54a31a241a59179ffe368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e023aefb-064b-4681-a4cc-7fa6823353c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e023aefb-064b-4681-a4cc-7fa6823353c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804f5170-555f-4c7a-80bf-1f74e90a6ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804f5170-555f-4c7a-80bf-1f74e90a6ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942473ab-97d4-46df-9861-d72ba5ad38ef', 'volume_name': 'volume-942473ab-97d4-46df-9861-d72ba5ad38ef', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d95c410-d4e1-47f6-9133-44c17b1b15e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d95c410-d4e1-47f6-9133-44c17b1b15e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505cbb18-b7ba-47f0-b222-6110a390fef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:57 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Volume 942473ab-97d4-46df-9861-d72ba5ad38ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942473ab-97d4-46df-9861-d72ba5ad38ef', 'volume_size': 1} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554302493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942473ab-97d4-46df-9861-d72ba5ad38ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9048d0d167a046ddbe2dd06f7351c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:57Z,use_quota=True,user_id='70ff0c0885c54a31a241a59179ffe368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Creating volume 942473ab-97d4-46df-9861-d72ba5ad38ef {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:48:57 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:48:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-942473ab-97d4-46df-9861-d72ba5ad38ef 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:57 devstack quobyte-client[83739]: System call of process 99545 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:48:57 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=146, name=volume-942473ab-97d4-46df-9861-d72ba5ad38ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:48:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-942473ab-97d4-46df-9861-d72ba5ad38ef 1073741824" returned: 0 in 0.877s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-942473ab-97d4-46df-9861-d72ba5ad38ef {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:58 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:58 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:48:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Flow 'volume_create_manager' (f84125fe-0a70-40e8-8380-c16015cdde2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:58 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40073b8-5d73-46de-afc4-8c43397af4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40073b8-5d73-46de-afc4-8c43397af4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1156884203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed05b53-e251-49a0-8c2c-75a9dbbc3746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9048d0d167a046ddbe2dd06f7351c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:57Z,use_quota=True,user_id='70ff0c0885c54a31a241a59179ffe368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abdda04-c66f-49de-9ff6-644c9507acfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abdda04-c66f-49de-9ff6-644c9507acfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710393f5-2ad4-43f8-940a-08d5125b1788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710393f5-2ad4-43f8-940a-08d5125b1788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed05b53-e251-49a0-8c2c-75a9dbbc3746', 'volume_name': 'volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbc194b-1b94-4996-8a8c-4c84437401a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbc194b-1b94-4996-8a8c-4c84437401a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf42e0d-f4cd-4c26-b9b8-80156c0a0727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:48:59 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Volume 3ed05b53-e251-49a0-8c2c-75a9dbbc3746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746', 'volume_size': 1} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-942473ab-97d4-46df-9861-d72ba5ad38ef" returned: 0 in 0.994s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] <== create_volume: return (1989ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.065s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1156884203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed05b53-e251-49a0-8c2c-75a9dbbc3746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9048d0d167a046ddbe2dd06f7351c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:57Z,use_quota=True,user_id='70ff0c0885c54a31a241a59179ffe368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Creating volume 3ed05b53-e251-49a0-8c2c-75a9dbbc3746 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:48:59 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:48:59 devstack quobyte-client[83739]: System call of process 99549 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:48:59 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=147, name=volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:48:59 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Flow 'volume_create_manager' (97f0d2de-54fc-4434-b0cd-00a30e792cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:48:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1288e8d-157d-410d-876c-353996b5a545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Flow 'volume_create_manager' (a5471e1d-9955-4909-831b-5df99f67184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991359a8-3eb7-4ee8-89a1-dc42d637df2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505cbb18-b7ba-47f0-b222-6110a390fef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942473ab-97d4-46df-9861-d72ba5ad38ef', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fffb034-1411-4f1b-af17-624ebc6f2d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Volume volume-942473ab-97d4-46df-9861-d72ba5ad38ef (942473ab-97d4-46df-9861-d72ba5ad38ef): created successfully Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fffb034-1411-4f1b-af17-624ebc6f2d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Flow 'volume_create_manager' (c2f907ce-7a1f-40d1-934a-08190dd9f5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1288e8d-157d-410d-876c-353996b5a545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639486082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9720d3d9-97b7-477d-a8a8-12a3388ed4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9048d0d167a046ddbe2dd06f7351c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:59Z,use_quota=True,user_id='70ff0c0885c54a31a241a59179ffe368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a51211-e7d4-4d46-bbed-5027eabfacd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a51211-e7d4-4d46-bbed-5027eabfacd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35037c92-703a-4480-ba8b-2d7af93ae9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35037c92-703a-4480-ba8b-2d7af93ae9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9720d3d9-97b7-477d-a8a8-12a3388ed4e5', 'volume_name': 'volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4580d1db-c491-4c71-a86b-daf5f4f49123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4580d1db-c491-4c71-a86b-daf5f4f49123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3c4e23-b4af-4516-b0db-de86d9653a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Volume 9720d3d9-97b7-477d-a8a8-12a3388ed4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5', 'volume_size': 1} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746 1073741824" returned: 0 in 0.932s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991359a8-3eb7-4ee8-89a1-dc42d637df2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108233149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae21826-fa48-47f1-afdd-196bda9aa6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9048d0d167a046ddbe2dd06f7351c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:58Z,use_quota=True,user_id='70ff0c0885c54a31a241a59179ffe368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1b22b0-d585-4253-999d-1fa1b39deb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1b22b0-d585-4253-999d-1fa1b39deb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb7ee46-1d46-44f1-860c-54da5fffd50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb7ee46-1d46-44f1-860c-54da5fffd50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae21826-fa48-47f1-afdd-196bda9aa6cc', 'volume_name': 'volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96f90e6-a2e9-41f0-a8fd-df38970eb882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96f90e6-a2e9-41f0-a8fd-df38970eb882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0e03f9-3fcf-4e1a-8e00-92b1d394e2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Volume 2ae21826-fa48-47f1-afdd-196bda9aa6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc', 'volume_size': 1} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:00 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4e85d701-e235-49fd-80a5-32fb23146e71 tempest-CreateVolumesFromImageTest-337100604 None] Created volume successfully. Sep 17 18:49:00 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Flow 'volume_create_manager' (51a444b8-bd67-4526-8830-77ff8c8229f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395af96b-363a-43f9-824c-bc60ad99f97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746" returned: 0 in 0.725s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] <== create_volume: return (1700ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.817s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639486082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9720d3d9-97b7-477d-a8a8-12a3388ed4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9048d0d167a046ddbe2dd06f7351c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:59Z,use_quota=True,user_id='70ff0c0885c54a31a241a59179ffe368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Creating volume 9720d3d9-97b7-477d-a8a8-12a3388ed4e5 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:01 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:01 devstack quobyte-client[83739]: System call of process 99553 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:01 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=148, name=volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395af96b-363a-43f9-824c-bc60ad99f97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665747658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605b9bb1-95b4-4009-b67e-d75f2101b78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9048d0d167a046ddbe2dd06f7351c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:59Z,use_quota=True,user_id='70ff0c0885c54a31a241a59179ffe368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eecbf3c-5b6b-4929-8282-13fa46c6e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eecbf3c-5b6b-4929-8282-13fa46c6e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff43d7d-fa33-4f55-9f29-2030ccf9e50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff43d7d-fa33-4f55-9f29-2030ccf9e50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605b9bb1-95b4-4009-b67e-d75f2101b78f', 'volume_name': 'volume-605b9bb1-95b4-4009-b67e-d75f2101b78f', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c016093-ce3f-4626-be14-1d281f20425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c016093-ce3f-4626-be14-1d281f20425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fdcd1b-f392-4afb-9ff0-08a15b9468b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:01 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Volume 605b9bb1-95b4-4009-b67e-d75f2101b78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605b9bb1-95b4-4009-b67e-d75f2101b78f', 'volume_size': 1} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf42e0d-f4cd-4c26-b9b8-80156c0a0727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220c3dc8-c568-4862-950a-f41efdd76e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5 1073741824" returned: 0 in 0.737s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:02 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Volume volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746 (3ed05b53-e251-49a0-8c2c-75a9dbbc3746): created successfully Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220c3dc8-c568-4862-950a-f41efdd76e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Flow 'volume_create_manager' (f84125fe-0a70-40e8-8380-c16015cdde2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5" returned: 0 in 0.426s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] <== create_volume: return (1197ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.494s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108233149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae21826-fa48-47f1-afdd-196bda9aa6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9048d0d167a046ddbe2dd06f7351c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:58Z,use_quota=True,user_id='70ff0c0885c54a31a241a59179ffe368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Creating volume 2ae21826-fa48-47f1-afdd-196bda9aa6cc {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:02 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:02 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=149, name=volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc 1073741824" returned: 0 in 0.411s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc" returned: 0 in 0.084s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] <== create_volume: return (569ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.589s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.461s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665747658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605b9bb1-95b4-4009-b67e-d75f2101b78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9048d0d167a046ddbe2dd06f7351c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:48:59Z,use_quota=True,user_id='70ff0c0885c54a31a241a59179ffe368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Creating volume 605b9bb1-95b4-4009-b67e-d75f2101b78f {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:03 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-605b9bb1-95b4-4009-b67e-d75f2101b78f 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:03 devstack quobyte-client[83739]: System call of process 99561 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:03 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=150, name=volume-605b9bb1-95b4-4009-b67e-d75f2101b78f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:03 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Flow 'volume_create_manager' (f442ca41-248e-4d24-b179-44188e1f5534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87be9805-513e-4c0f-ab48-f7e1aa8c42c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87be9805-513e-4c0f-ab48-f7e1aa8c42c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7293fc2e-d010-4fd7-94a0-4d18299a6201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e9a146186e4f4d8a584e63516651f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:01Z,use_quota=True,user_id='31c0d020587b4a7bb286633a3b56cd22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca270c6-b81e-4c86-99a1-fd04815fc5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca270c6-b81e-4c86-99a1-fd04815fc5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232b7742-5800-4fbb-8666-93c877e1e735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.image.glance [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Creating Keystone auth plugin from conf {{(pid=83736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0e03f9-3fcf-4e1a-8e00-92b1d394e2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17b298b-9498-4077-a975-a3fe6b111340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:03 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d3ee2d6c-7d74-49a4-afe9-985576948767 tempest-CreateVolumesFromImageTest-337100604 None] Created volume successfully. Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3c4e23-b4af-4516-b0db-de86d9653a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de990ce1-a071-4b02-9413-c4a88304b886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:03 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Volume volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc (2ae21826-fa48-47f1-afdd-196bda9aa6cc): created successfully Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17b298b-9498-4077-a975-a3fe6b111340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Flow 'volume_create_manager' (a5471e1d-9955-4909-831b-5df99f67184e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-605b9bb1-95b4-4009-b67e-d75f2101b78f 1073741824" returned: 0 in 0.858s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:03 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Volume volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5 (9720d3d9-97b7-477d-a8a8-12a3388ed4e5): created successfully Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de990ce1-a071-4b02-9413-c4a88304b886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Flow 'volume_create_manager' (97f0d2de-54fc-4434-b0cd-00a30e792cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-605b9bb1-95b4-4009-b67e-d75f2101b78f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:04 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-f2544169-8966-415b-82a7-243164f3ee91 tempest-CreateVolumesFromImageTest-337100604 None] Created volume successfully. Sep 17 18:49:04 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-81f7a31d-911c-4ea3-9604-3ab2c72088b5 tempest-CreateVolumesFromImageTest-337100604 None] Created volume successfully. Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-605b9bb1-95b4-4009-b67e-d75f2101b78f" returned: 0 in 0.457s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] <== create_volume: return (1363ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fdcd1b-f392-4afb-9ff0-08a15b9468b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605b9bb1-95b4-4009-b67e-d75f2101b78f', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7a0f2b-2a5f-4ac1-b3c8-7d4543cc3f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:04 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Volume volume-605b9bb1-95b4-4009-b67e-d75f2101b78f (605b9bb1-95b4-4009-b67e-d75f2101b78f): created successfully Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7a0f2b-2a5f-4ac1-b3c8-7d4543cc3f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Flow 'volume_create_manager' (51a444b8-bd67-4526-8830-77ff8c8229f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:04 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2af24f67-aa0a-48e8-afa9-63f06f4289f0 tempest-CreateVolumesFromImageTest-337100604 None] Created volume successfully. Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232b7742-5800-4fbb-8666-93c877e1e735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7293fc2e-d010-4fd7-94a0-4d18299a6201', 'volume_name': 'volume-7293fc2e-d010-4fd7-94a0-4d18299a6201', 'volume_size': 1, 'image_id': '4aa32bae-293c-4e4c-a005-ada86a7ef938', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4aa32bae-293c-4e4c-a005-ada86a7ef938', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9b0eebf962b0cc8b1b67eb75585ff76d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92e9a146186e4f4d8a584e63516651f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49aff7ff68229a337d58efef7fb4b9670ee73ee60dd6deaae310bc55de10d5f15398b5f312b0df4584a1d8de0728d8560b931039a32a52a4c07696458a287bcb', 'id': '4aa32bae-293c-4e4c-a005-ada86a7ef938', 'created_at': datetime.datetime(2025, 9, 17, 16, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4aa32bae-293c-4e4c-a005-ada86a7ef938/file', 'properties': {}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b478b3c-edf0-4f10-a926-ac85421ec44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b478b3c-edf0-4f10-a926-ac85421ec44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d34fd9d-7b61-477a-852b-f08435b65c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:04 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Volume 7293fc2e-d010-4fd7-94a0-4d18299a6201: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7293fc2e-d010-4fd7-94a0-4d18299a6201', 'volume_size': 1, 'image_id': '4aa32bae-293c-4e4c-a005-ada86a7ef938', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4aa32bae-293c-4e4c-a005-ada86a7ef938', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9b0eebf962b0cc8b1b67eb75585ff76d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92e9a146186e4f4d8a584e63516651f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49aff7ff68229a337d58efef7fb4b9670ee73ee60dd6deaae310bc55de10d5f15398b5f312b0df4584a1d8de0728d8560b931039a32a52a4c07696458a287bcb', 'id': '4aa32bae-293c-4e4c-a005-ada86a7ef938', 'created_at': datetime.datetime(2025, 9, 17, 16, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4aa32bae-293c-4e4c-a005-ada86a7ef938/file', 'properties': {}}, 'image_service': } Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Cloning 7293fc2e-d010-4fd7-94a0-4d18299a6201 from image 4aa32bae-293c-4e4c-a005-ada86a7ef938 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4aa32bae-293c-4e4c-a005-ada86a7ef938', 'metadata': {}}]). {{(pid=83736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 18:49:04 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Image download 0.00 MB at 0.00 MB/s Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[694f57a0-2e8b-4b69-a6a2-f5f1f621c357]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:05 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD Sep 17 18:49:05 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:49:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "cinder-605b9bb1-95b4-4009-b67e-d75f2101b78f-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-605b9bb1-95b4-4009-b67e-d75f2101b78f-delete_volume" acquired by "delete_volume" :: waited 0.201s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:06 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "cinder-quobyte-605b9bb1-95b4-4009-b67e-d75f2101b78f" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-quobyte-605b9bb1-95b4-4009-b67e-d75f2101b78f" acquired by "delete_volume" :: waited 0.026s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:06 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[13103954-3a29-497d-9ced-beb217ad465e]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-605b9bb1-95b4-4009-b67e-d75f2101b78f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:07 devstack quobyte-client[83739]: System call of process 99570 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-605b9bb1-95b4-4009-b67e-d75f2101b78f" returned: 0 in 1.297s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-605b9bb1-95b4-4009-b67e-d75f2101b78f {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:08 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Sep 17 18:49:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-605b9bb1-95b4-4009-b67e-d75f2101b78f" returned: 0 in 0.326s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD" returned: 0 in 3.666s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:08 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-quobyte-605b9bb1-95b4-4009-b67e-d75f2101b78f" released by "delete_volume" :: held 2.278s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:09 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Created reservations ['e5758715-d3d0-4cfd-adbf-41e2fa9ed823', '56e07533-3fe5-4b1f-9bac-3fb08e0dc069', '77858189-589a-4113-b843-6f315510f19e', '402088fc-fffc-4e11-af60-38a4a432d1c9'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:49:09 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD Sep 17 18:49:09 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:49:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:09 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.186s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:10 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:49:10 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Deleted volume successfully. Sep 17 18:49:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-1970aef4-6de3-49f1-8883-4890e6ce7669 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-605b9bb1-95b4-4009-b67e-d75f2101b78f-delete_volume" released by "delete_volume" :: held 4.465s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "cinder-9720d3d9-97b7-477d-a8a8-12a3388ed4e5-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-9720d3d9-97b7-477d-a8a8-12a3388ed4e5-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:11 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:11 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "cinder-quobyte-9720d3d9-97b7-477d-a8a8-12a3388ed4e5" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:11 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-quobyte-9720d3d9-97b7-477d-a8a8-12a3388ed4e5" acquired by "delete_volume" :: waited 0.027s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:11 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c603940-8de5-479e-959a-16efb6160c27]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5" returned: 0 in 0.888s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-9720d3d9-97b7-477d-a8a8-12a3388ed4e5" returned: 0 in 0.243s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:12 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 17 18:49:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-quobyte-9720d3d9-97b7-477d-a8a8-12a3388ed4e5" released by "delete_volume" :: held 1.409s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD" returned: 1 in 4.158s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:49:12 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Temporary image 4aa32bae-293c-4e4c-a005-ada86a7ef938 is fetched for user 31c0d020587b4a7bb286633a3b56cd22. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 18:49:12 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Created reservations ['cdfdc162-7877-46a7-8b2a-aeb65111f701', '4c227b74-fbd3-45a2-ab83-a6084dd3c3a4', 'a0e35aff-f191-460a-a173-7a7a98a24381', '66d513ff-8e67-467d-ac97-39ce4a766260'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:49:13 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcf68ee-bf41-4ce6-964a-72bc63030d29]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:13 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD Sep 17 18:49:13 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:49:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.158s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:13 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:49:13 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Deleted volume successfully. Sep 17 18:49:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e497cf44-928a-4c04-a6bd-030c938e0791 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-9720d3d9-97b7-477d-a8a8-12a3388ed4e5-delete_volume" released by "delete_volume" :: held 3.314s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "cinder-2ae21826-fa48-47f1-afdd-196bda9aa6cc-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-2ae21826-fa48-47f1-afdd-196bda9aa6cc-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:14 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "cinder-quobyte-2ae21826-fa48-47f1-afdd-196bda9aa6cc" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-quobyte-2ae21826-fa48-47f1-afdd-196bda9aa6cc" acquired by "delete_volume" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:14 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12763a3-299d-48b0-8f0f-607023ea4b65]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc" returned: 0 in 0.603s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ae21826-fa48-47f1-afdd-196bda9aa6cc" returned: 0 in 0.272s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-quobyte-2ae21826-fa48-47f1-afdd-196bda9aa6cc" released by "delete_volume" :: held 1.161s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:16 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Sep 17 18:49:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD" returned: 0 in 3.229s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:16 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Created reservations ['027cec90-30e9-4e73-bbba-78193bc22fb8', 'b81c2e9a-c182-47a1-a771-902e985fe50b', '6e781af9-f513-4362-97e8-d9815fd67091', '9e092b83-f98d-4cf3-8167-7122ad678819'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:49:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "cinder-3ed05b53-e251-49a0-8c2c-75a9dbbc3746-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:17 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD Sep 17 18:49:17 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 18:49:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-3ed05b53-e251-49a0-8c2c-75a9dbbc3746-delete_volume" acquired by "delete_volume" :: waited 0.171s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.594s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:17 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:49:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:49:18 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Deleted volume successfully. Sep 17 18:49:18 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "cinder-quobyte-3ed05b53-e251-49a0-8c2c-75a9dbbc3746" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.764s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2098c6a7-e859-419a-8781-aaeaa6440ffa tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-2ae21826-fa48-47f1-afdd-196bda9aa6cc-delete_volume" released by "delete_volume" :: held 3.813s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:18 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:49:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-quobyte-3ed05b53-e251-49a0-8c2c-75a9dbbc3746" acquired by "delete_volume" :: waited 0.102s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:18 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e65a6e-f5bb-440d-864d-502e224b6171]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746" returned: 0 in 0.806s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:19 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3ed05b53-e251-49a0-8c2c-75a9dbbc3746" returned: 0 in 0.252s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-quobyte-3ed05b53-e251-49a0-8c2c-75a9dbbc3746" released by "delete_volume" :: held 1.374s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD" returned: 1 in 3.586s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7293fc2e-d010-4fd7-94a0-4d18299a6201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e9a146186e4f4d8a584e63516651f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:01Z,use_quota=True,user_id='31c0d020587b4a7bb286633a3b56cd22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Creating volume 7293fc2e-d010-4fd7-94a0-4d18299a6201 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:19 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:20 devstack quobyte-client[83739]: System call of process 99609 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:20 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=151, name=volume-7293fc2e-d010-4fd7-94a0-4d18299a6201, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 1073741824" returned: 0 in 0.530s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:20 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Created reservations ['41df4560-0a45-4e00-9f37-a05d6e7357e0', '5c9cf3b3-1df7-4a06-9803-a2e697d6ebaf', 'c6ed74cb-921e-4f37-99c5-144a6d6340f7', '656b999d-d747-43e3-9cbb-c8fa7b2c573e'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:49:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201" returned: 0 in 0.321s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:20 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] <== create_volume: return (901ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:20 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Attempting download of 4aa32bae-293c-4e4c-a005-ada86a7ef938 ((None, [{'url': 'file:///opt/stack/data/glance/images/4aa32bae-293c-4e4c-a005-ada86a7ef938', 'metadata': {}}])) to volume 7293fc2e-d010-4fd7-94a0-4d18299a6201. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 18:49:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:21 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[379a54bf-2ba0-49c8-bafb-3248d7cf3a9f]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4aa32bae-293c-4e4c-a005-ada86a7ef938_1y4bhn13 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.457s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:21 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:49:21 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Deleted volume successfully. Sep 17 18:49:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "cinder-942473ab-97d4-46df-9861-d72ba5ad38ef-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-942473ab-97d4-46df-9861-d72ba5ad38ef-delete_volume" acquired by "delete_volume" :: waited 0.182s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:22 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-7d186e0d-c6e6-44be-8e44-2093cd8248e4 tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-3ed05b53-e251-49a0-8c2c-75a9dbbc3746-delete_volume" released by "delete_volume" :: held 5.206s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4aa32bae-293c-4e4c-a005-ada86a7ef938_1y4bhn13" returned: 0 in 1.039s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:22 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4aa32bae-293c-4e4c-a005-ada86a7ef938_1y4bhn13 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:23 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "cinder-quobyte-942473ab-97d4-46df-9861-d72ba5ad38ef" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:23 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-quobyte-942473ab-97d4-46df-9861-d72ba5ad38ef" acquired by "delete_volume" :: waited 0.133s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:23 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d91120a-2969-4c19-8b08-e8a5a3cea3bd]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-942473ab-97d4-46df-9861-d72ba5ad38ef {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4aa32bae-293c-4e4c-a005-ada86a7ef938_1y4bhn13" returned: 1 in 1.268s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4aa32bae-293c-4e4c-a005-ada86a7ef938_1y4bhn13' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:49:23 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1682404-de6a-43d9-8353-d67e49a369a9]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:23 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-942473ab-97d4-46df-9861-d72ba5ad38ef" returned: 0 in 0.732s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-942473ab-97d4-46df-9861-d72ba5ad38ef {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD" returned: 0 in 0.679s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:24 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-942473ab-97d4-46df-9861-d72ba5ad38ef" returned: 0 in 0.459s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:25 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-quobyte-942473ab-97d4-46df-9861-d72ba5ad38ef" released by "delete_volume" :: held 1.601s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD" returned: 1 in 1.052s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:49:25 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] 4aa32bae-293c-4e4c-a005-ada86a7ef938 was raw, converting to raw {{(pid=83736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 18:49:25 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:26 devstack quobyte-client[83739]: System call of process 99665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:26 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=151, name=volume-7293fc2e-d010-4fd7-94a0-4d18299a6201, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201" returned: 0 in 0.352s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:26 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4aa32bae-293c-4e4c-a005-ada86a7ef938_9ozp25hodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:49:26 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 18:49:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 1G" returned: 0 in 0.563s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:26 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Created reservations ['1a9eac7d-88ba-4882-9fa7-2b3b7dbc068f', 'b12d6d51-a0ff-49ea-989c-a1b880aaee5c', 'e0a080ad-341f-47eb-ac8c-16e484147e36', 'e14e0b83-ae8b-424b-afab-d4881e0c3127'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:49:26 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a72de32-53ab-4ebd-a72a-26c6c7057dc9]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.047s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:27 devstack quobyte-client[83739]: System call of process 99672 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201" returned: 0 in 0.821s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.504s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:28 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:49:28 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Deleted volume successfully. Sep 17 18:49:28 devstack quobyte-client[83739]: System call of process 99675 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201" returned: 1 in 0.756s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:49:28 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Downloaded image 4aa32bae-293c-4e4c-a005-ada86a7ef938 ((None, [{'url': 'file:///opt/stack/data/glance/images/4aa32bae-293c-4e4c-a005-ada86a7ef938', 'metadata': {}}])) to volume 7293fc2e-d010-4fd7-94a0-4d18299a6201 successfully. {{(pid=83736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 18:49:28 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Temporary image 4aa32bae-293c-4e4c-a005-ada86a7ef938 for user 31c0d020587b4a7bb286633a3b56cd22 is deleted. {{(pid=83736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 18:49:28 devstack cinder-volume[83736]: DEBUG cinder.volume.volume_utils [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Marking volume 7293fc2e-d010-4fd7-94a0-4d18299a6201 as bootable. {{(pid=83736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 18:49:28 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-120919a3-26ad-4ea4-b0c5-458839a0d79f tempest-CreateVolumesFromImageTest-337100604 None] Lock "cinder-942473ab-97d4-46df-9861-d72ba5ad38ef-delete_volume" released by "delete_volume" :: held 6.379s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:28 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Copying metadata from image 4aa32bae-293c-4e4c-a005-ada86a7ef938 to 7293fc2e-d010-4fd7-94a0-4d18299a6201. {{(pid=83736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 18:49:28 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Creating volume glance metadata for volume 7293fc2e-d010-4fd7-94a0-4d18299a6201 backed by image 4aa32bae-293c-4e4c-a005-ada86a7ef938 with: {'image_id': '4aa32bae-293c-4e4c-a005-ada86a7ef938', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9b0eebf962b0cc8b1b67eb75585ff76d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 18:49:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d34fd9d-7b61-477a-852b-f08435b65c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7293fc2e-d010-4fd7-94a0-4d18299a6201', 'volume_size': 1, 'image_id': '4aa32bae-293c-4e4c-a005-ada86a7ef938', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4aa32bae-293c-4e4c-a005-ada86a7ef938', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9b0eebf962b0cc8b1b67eb75585ff76d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92e9a146186e4f4d8a584e63516651f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49aff7ff68229a337d58efef7fb4b9670ee73ee60dd6deaae310bc55de10d5f15398b5f312b0df4584a1d8de0728d8560b931039a32a52a4c07696458a287bcb', 'id': '4aa32bae-293c-4e4c-a005-ada86a7ef938', 'created_at': datetime.datetime(2025, 9, 17, 16, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 16, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4aa32bae-293c-4e4c-a005-ada86a7ef938/file', 'properties': {}}, 'image_service': }' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7170bae0-9cf3-438a-9c50-b8420935f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:29 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Volume volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 (7293fc2e-d010-4fd7-94a0-4d18299a6201): created successfully Sep 17 18:49:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7170bae0-9cf3-438a-9c50-b8420935f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Flow 'volume_create_manager' (f442ca41-248e-4d24-b179-44188e1f5534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:29 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-05e6f0e7-662d-4e39-ad0c-7704b489032a tempest-VolumeImageDependencyTests-16237632 None] Created volume successfully. Sep 17 18:49:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Acquiring lock "cinder-7293fc2e-d010-4fd7-94a0-4d18299a6201-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Lock "cinder-7293fc2e-d010-4fd7-94a0-4d18299a6201-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:30 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Acquiring lock "cinder-quobyte-7293fc2e-d010-4fd7-94a0-4d18299a6201" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:30 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Lock "cinder-quobyte-7293fc2e-d010-4fd7-94a0-4d18299a6201" acquired by "delete_volume" :: waited 0.016s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:30 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dade031d-52c0-4563-81ee-d5a78b23ac4c]: (4, 'raw') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:30 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201" returned: 0 in 0.830s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201" returned: 1 in 0.637s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201' failed. Not Retrying. {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 18:49:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-7293fc2e-d010-4fd7-94a0-4d18299a6201" returned: 0 in 0.129s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:32 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Lock "cinder-quobyte-7293fc2e-d010-4fd7-94a0-4d18299a6201" released by "delete_volume" :: held 1.978s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:33 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Created reservations ['f7ea876c-a9d4-4252-9613-bc5945121146', '42470aa3-f10e-436d-9d57-2f40c24c233c', '21e68812-d729-42ca-942f-e59fc45a3ee3', '0d29e6f8-6027-472c-842b-0d57028ac93e'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:49:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.132s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:33 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:49:33 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Deleted volume successfully. Sep 17 18:49:33 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d1124a22-ad79-4f26-8529-9fb36a1abec1 tempest-VolumeImageDependencyTests-16237632 None] Lock "cinder-7293fc2e-d010-4fd7-94a0-4d18299a6201-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:34 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (b5c391fa-0dfc-4fa2-a40d-29977ad50021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c819d8c-3eca-4a9c-9022-d4862d42b5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c819d8c-3eca-4a9c-9022-d4862d42b5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1293353022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6056aecc-77bd-4bf0-aa22-ab4e47bb86cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:34Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0450e1-0a56-4d0a-ac65-be0f695b034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0450e1-0a56-4d0a-ac65-be0f695b034f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb54b5d0-3d34-485a-8db9-4d87a5d4aeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb54b5d0-3d34-485a-8db9-4d87a5d4aeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6056aecc-77bd-4bf0-aa22-ab4e47bb86cf', 'volume_name': 'volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0e4c1d-071b-4d0d-a374-a9a4fe9f027b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0e4c1d-071b-4d0d-a374-a9a4fe9f027b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b113ed-9871-4a4b-b9ee-a9752a12396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:34 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume 6056aecc-77bd-4bf0-aa22-ab4e47bb86cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf', 'volume_size': 1} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1293353022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6056aecc-77bd-4bf0-aa22-ab4e47bb86cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:34Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Creating volume 6056aecc-77bd-4bf0-aa22-ab4e47bb86cf {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:34 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:35 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:35 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=152, name=volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Flow 'volume_create_manager' (eae4be8b-96e7-4a0d-aa0e-a0a37824edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555514ff-4500-4ece-b244-88878e1f697c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555514ff-4500-4ece-b244-88878e1f697c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2010094484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65125c8-bc9f-4911-a05d-83a13a435260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d42061747c4186871b00d96c3f0688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:35Z,use_quota=True,user_id='dae1920f4acb45f3b1943b9cba43e080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9834730-cefe-4b69-b944-45eae9f53e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9834730-cefe-4b69-b944-45eae9f53e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a19bd7f-3da2-4324-af08-ec9d552c60e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a19bd7f-3da2-4324-af08-ec9d552c60e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f65125c8-bc9f-4911-a05d-83a13a435260', 'volume_name': 'volume-f65125c8-bc9f-4911-a05d-83a13a435260', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122f8ce0-9b7d-4444-9a68-28b3cde91d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122f8ce0-9b7d-4444-9a68-28b3cde91d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33cff47-fc50-4382-9ff0-e1ebbb71e4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:35 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Volume f65125c8-bc9f-4911-a05d-83a13a435260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f65125c8-bc9f-4911-a05d-83a13a435260', 'volume_size': 1} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf 1073741824" returned: 0 in 0.745s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf" returned: 0 in 0.132s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] <== create_volume: return (920ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.354s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2010094484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65125c8-bc9f-4911-a05d-83a13a435260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d42061747c4186871b00d96c3f0688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:35Z,use_quota=True,user_id='dae1920f4acb45f3b1943b9cba43e080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Creating volume f65125c8-bc9f-4911-a05d-83a13a435260 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:36 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:36 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=153, name=volume-f65125c8-bc9f-4911-a05d-83a13a435260, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b113ed-9871-4a4b-b9ee-a9752a12396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5615b66-d3f4-43eb-9c60-7cf0ed057a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:36 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf (6056aecc-77bd-4bf0-aa22-ab4e47bb86cf): created successfully Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5615b66-d3f4-43eb-9c60-7cf0ed057a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (b5c391fa-0dfc-4fa2-a40d-29977ad50021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 1073741824" returned: 0 in 0.472s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:36 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c4cae44e-d3dc-41f2-9275-86f3e9275d64 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created volume successfully. Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260" returned: 0 in 0.427s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] <== create_volume: return (937ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33cff47-fc50-4382-9ff0-e1ebbb71e4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f65125c8-bc9f-4911-a05d-83a13a435260', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f73a971-5b30-48ef-8353-033d06a15abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:37 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Volume volume-f65125c8-bc9f-4911-a05d-83a13a435260 (f65125c8-bc9f-4911-a05d-83a13a435260): created successfully Sep 17 18:49:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f73a971-5b30-48ef-8353-033d06a15abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:37 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Flow 'volume_create_manager' (eae4be8b-96e7-4a0d-aa0e-a0a37824edf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:37 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Creating offline snapshot df6391f5-792c-4c39-8d9a-c90f6d189c40 of volume 6056aecc-77bd-4bf0-aa22-ab4e47bb86cf {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:49:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-13c28d98-58c0-4c7a-9315-653c89817d02 tempest-SnapshotDependencyTests-682388138 None] Created volume successfully. Sep 17 18:49:37 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[414a1e42-c2db-4f36-a39e-3a883c1de93c]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf" returned: 0 in 0.438s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:37 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=154, name=volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40 1G" returned: 0 in 0.234s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "qemu-img rebase -u -b volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40" returned: 0 in 0.146s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40" returned: 0 in 0.091s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40" returned: 0 in 0.265s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.info" returned: 0 in 0.197s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:49:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.info" returned: 0 in 0.129s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-e2cfa00a-fa34-4054-87c0-af32e215f74b tempest-CreateVolumesFromSnapshotTest-1776211746 None] Create snapshot completed successfully Sep 17 18:49:39 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:39 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Creating offline snapshot 350d4324-f44b-4edf-baac-dcbb16f11943 of volume f65125c8-bc9f-4911-a05d-83a13a435260 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:49:39 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[08704e10-2ef6-4833-b3ed-7b23f8a101b2]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260" returned: 0 in 0.450s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:40 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=156, name=volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943 1G" returned: 0 in 0.290s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f65125c8-bc9f-4911-a05d-83a13a435260 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] CMD "qemu-img rebase -u -b volume-f65125c8-bc9f-4911-a05d-83a13a435260 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943" returned: 0 in 0.229s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:40 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:49:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943" returned: 0 in 0.432s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:41 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Flow 'volume_create_manager' (45c0ecf9-4f83-4253-9144-4e6897d361a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54def1fb-f870-43ff-b893-7b2152bf0585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54def1fb-f870-43ff-b893-7b2152bf0585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aaa3428-0ac1-4f35-be89-c310d2e1155c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22309ddd954848bbb3706b8441660279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:41Z,use_quota=True,user_id='3fd1580ea5f347eebe7f91daa490f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8418b937-1b4d-4504-a621-7ed825670bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8418b937-1b4d-4504-a621-7ed825670bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0f46fb-55aa-44cf-9c55-231d1740ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0f46fb-55aa-44cf-9c55-231d1740ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aaa3428-0ac1-4f35-be89-c310d2e1155c', 'volume_name': 'volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef29f92-8617-489a-869c-936342e577f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef29f92-8617-489a-869c-936342e577f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7019c75-3f28-443e-bd52-4e5040743094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:41 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Volume 4aaa3428-0ac1-4f35-be89-c310d2e1155c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c', 'volume_size': 1} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:41 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (d5c0f081-a2b4-4dad-a10f-26880e68ee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f186826c-6751-47fb-ba93-d21ddf543408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f186826c-6751-47fb-ba93-d21ddf543408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-702776038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd00202-d834-42ba-922a-443ec6d40b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:41Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfe3b6a-3557-4ff3-92ac-f96b2268a7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfe3b6a-3557-4ff3-92ac-f96b2268a7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5fcb7e-3752-4c8a-a9a6-d8c5df58a20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5fcb7e-3752-4c8a-a9a6-d8c5df58a20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd00202-d834-42ba-922a-443ec6d40b64', 'volume_name': 'volume-2bd00202-d834-42ba-922a-443ec6d40b64', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6aa01ab-ad68-40fd-8222-6953d46553bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6aa01ab-ad68-40fd-8222-6953d46553bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313a79f0-54ff-47f9-bdac-d3c0f3e54ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:41 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume 2bd00202-d834-42ba-922a-443ec6d40b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd00202-d834-42ba-922a-443ec6d40b64', 'volume_size': 1} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943" returned: 0 in 0.703s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:42 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (e5bf0408-3256-4f25-8c95-694374875f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a06d194-dc02-4437-a0c0-05890c49cde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a06d194-dc02-4437-a0c0-05890c49cde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-168758311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a10f72c-2369-45fc-858d-2e60ce91e650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:41Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16809500-1bc2-4024-87f4-3eecad6664c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16809500-1bc2-4024-87f4-3eecad6664c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f6ac43-7003-4370-979b-fae19ad123ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f6ac43-7003-4370-979b-fae19ad123ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a10f72c-2369-45fc-858d-2e60ce91e650', 'volume_name': 'volume-8a10f72c-2369-45fc-858d-2e60ce91e650', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa675e0-0a85-4c81-8579-dbc427925d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa675e0-0a85-4c81-8579-dbc427925d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b846f340-0129-4f75-905c-d1cb7b6386c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:42 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume 8a10f72c-2369-45fc-858d-2e60ce91e650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a10f72c-2369-45fc-858d-2e60ce91e650', 'volume_size': 1} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.info" returned: 0 in 0.659s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:42 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (49b14e0f-aeb7-4594-969d-4f348fbf55bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:42 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22a4d58-9a38-42f8-b11d-cf99ceafe825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (abaf6b41-b3ea-4330-b81c-72090426c448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f641b4-cfe5-4c1b-a6c2-95f90a64f9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f641b4-cfe5-4c1b-a6c2-95f90a64f9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1449018889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f150e7e-c556-4320-9725-37b0bae38eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:42Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3fc023-965f-48f2-800b-023f2cf21772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3fc023-965f-48f2-800b-023f2cf21772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae87711-d75a-4bc2-baa7-db1df88e80e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae87711-d75a-4bc2-baa7-db1df88e80e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f150e7e-c556-4320-9725-37b0bae38eef', 'volume_name': 'volume-6f150e7e-c556-4320-9725-37b0bae38eef', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b803ee0-2189-4535-bfe6-96afa6012514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b803ee0-2189-4535-bfe6-96afa6012514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9174a92f-7537-4bd1-9a6b-5505cb4b89f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume 6f150e7e-c556-4320-9725-37b0bae38eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f150e7e-c556-4320-9725-37b0bae38eef', 'volume_size': 1} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.info" returned: 0 in 0.638s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.647s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:43 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (4b7d1cd1-5ed3-416e-aa32-f52f7412e12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8234f50-267d-4d28-b354-8dedc69e1d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.531s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aaa3428-0ac1-4f35-be89-c310d2e1155c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22309ddd954848bbb3706b8441660279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:41Z,use_quota=True,user_id='3fd1580ea5f347eebe7f91daa490f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Creating volume 4aaa3428-0ac1-4f35-be89-c310d2e1155c {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:43 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:43 devstack quobyte-client[83739]: System call of process 99722 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:43 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=158, name=volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22a4d58-9a38-42f8-b11d-cf99ceafe825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-902234952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43958347-b5e8-46ef-b868-a56cdd6cb9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:42Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db5e3e1-c852-481e-8c92-f3e4330c6be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db5e3e1-c852-481e-8c92-f3e4330c6be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcdd455-b09c-4cac-9729-747393749592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcdd455-b09c-4cac-9729-747393749592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43958347-b5e8-46ef-b868-a56cdd6cb9f3', 'volume_name': 'volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481439af-805f-472d-8cbb-e87ccc16b7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481439af-805f-472d-8cbb-e87ccc16b7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece2443a-93cc-409d-af84-7499c993d786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume 43958347-b5e8-46ef-b868-a56cdd6cb9f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3', 'volume_size': 1} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c 1073741824" returned: 0 in 0.492s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8234f50-267d-4d28-b354-8dedc69e1d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1199976803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90332da-569d-47e1-9a6b-280ee6e82b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:43Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0391d0-5ad2-48d4-aa19-8bcbbf44daa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0391d0-5ad2-48d4-aa19-8bcbbf44daa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c2c2b8-95bb-46b7-9f04-ff5e3e1241b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c2c2b8-95bb-46b7-9f04-ff5e3e1241b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90332da-569d-47e1-9a6b-280ee6e82b97', 'volume_name': 'volume-c90332da-569d-47e1-9a6b-280ee6e82b97', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:43 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da288130-62c2-4686-a249-9398b124681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da288130-62c2-4686-a249-9398b124681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3395e69b-d8b7-4daf-a73e-5478eded39b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:44 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume c90332da-569d-47e1-9a6b-280ee6e82b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90332da-569d-47e1-9a6b-280ee6e82b97', 'volume_size': 1} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-85d46df2-b6f9-4059-beb9-82fe0f957a34 tempest-SnapshotDependencyTests-682388138 None] Create snapshot completed successfully Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c" returned: 0 in 0.367s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] <== create_volume: return (881ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.313s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-702776038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd00202-d834-42ba-922a-443ec6d40b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:41Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Creating volume 2bd00202-d834-42ba-922a-443ec6d40b64 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:44 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2bd00202-d834-42ba-922a-443ec6d40b64 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:44 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=159, name=volume-2bd00202-d834-42ba-922a-443ec6d40b64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7019c75-3f28-443e-bd52-4e5040743094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495f02b7-0934-4b1e-805f-6e965a4869be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2bd00202-d834-42ba-922a-443ec6d40b64 1073741824" returned: 0 in 0.421s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2bd00202-d834-42ba-922a-443ec6d40b64 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:44 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Volume volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c (4aaa3428-0ac1-4f35-be89-c310d2e1155c): created successfully Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495f02b7-0934-4b1e-805f-6e965a4869be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Flow 'volume_create_manager' (45c0ecf9-4f83-4253-9144-4e6897d361a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-240153b9-3a91-4824-996a-04516dcdd27f tempest-CinderUnicodeTest-2037868990 None] Created volume successfully. Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2bd00202-d834-42ba-922a-443ec6d40b64" returned: 0 in 0.427s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:44 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] <== create_volume: return (873ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.585s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-168758311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a10f72c-2369-45fc-858d-2e60ce91e650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:41Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Creating volume 8a10f72c-2369-45fc-858d-2e60ce91e650 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:45 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8a10f72c-2369-45fc-858d-2e60ce91e650 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:45 devstack quobyte-client[83739]: System call of process 99730 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:45 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=160, name=volume-8a10f72c-2369-45fc-858d-2e60ce91e650, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313a79f0-54ff-47f9-bdac-d3c0f3e54ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd00202-d834-42ba-922a-443ec6d40b64', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31457b07-0655-4e10-ad65-60ea985b9d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:45 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume volume-2bd00202-d834-42ba-922a-443ec6d40b64 (2bd00202-d834-42ba-922a-443ec6d40b64): created successfully Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31457b07-0655-4e10-ad65-60ea985b9d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (d5c0f081-a2b4-4dad-a10f-26880e68ee99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8a10f72c-2369-45fc-858d-2e60ce91e650 1073741824" returned: 0 in 0.769s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8a10f72c-2369-45fc-858d-2e60ce91e650 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:46 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2a8ebafd-c602-4a31-b3a6-72e95422ec18 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created volume successfully. Sep 17 18:49:46 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Flow 'volume_create_manager' (63a3a8fd-b04e-4a6e-bc40-c4b29c22b1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3513ccd-497e-414b-861d-737785b3dcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8a10f72c-2369-45fc-858d-2e60ce91e650" returned: 0 in 0.498s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3513ccd-497e-414b-861d-737785b3dcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1002402051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1433ca62-b724-4727-86a7-823e9b494248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22309ddd954848bbb3706b8441660279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:46Z,use_quota=True,user_id='3fd1580ea5f347eebe7f91daa490f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe44f37-fbf2-4dfb-9132-4825dab55490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe44f37-fbf2-4dfb-9132-4825dab55490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a1a74e-8480-4354-9c08-7c0efcc3bf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a1a74e-8480-4354-9c08-7c0efcc3bf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1433ca62-b724-4727-86a7-823e9b494248', 'volume_name': 'volume-1433ca62-b724-4727-86a7-823e9b494248', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e322d64f-be4e-4d05-957a-7e9b99ff4580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e322d64f-be4e-4d05-957a-7e9b99ff4580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ddf8ac-5e42-4915-a580-9943873ff9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:46 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Volume 1433ca62-b724-4727-86a7-823e9b494248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1433ca62-b724-4727-86a7-823e9b494248', 'volume_size': 1} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] <== create_volume: return (1341ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.244s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1449018889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f150e7e-c556-4320-9725-37b0bae38eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:42Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Creating volume 6f150e7e-c556-4320-9725-37b0bae38eef {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:46 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6f150e7e-c556-4320-9725-37b0bae38eef 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:46 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=161, name=volume-6f150e7e-c556-4320-9725-37b0bae38eef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:46 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b846f340-0129-4f75-905c-d1cb7b6386c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a10f72c-2369-45fc-858d-2e60ce91e650', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a414f773-22bb-4c5f-8f65-fc66f17efa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6f150e7e-c556-4320-9725-37b0bae38eef 1073741824" returned: 0 in 0.540s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6f150e7e-c556-4320-9725-37b0bae38eef {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Flow 'volume_create_manager' (c5643321-518b-42d0-8dcd-86e459c78213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b292ee-6b43-4802-ac77-e3c0872d7771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:47 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume volume-8a10f72c-2369-45fc-858d-2e60ce91e650 (8a10f72c-2369-45fc-858d-2e60ce91e650): created successfully Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a414f773-22bb-4c5f-8f65-fc66f17efa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (e5bf0408-3256-4f25-8c95-694374875f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6f150e7e-c556-4320-9725-37b0bae38eef" returned: 0 in 0.488s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] <== create_volume: return (1050ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b292ee-6b43-4802-ac77-e3c0872d7771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7532f3-eb2d-4395-8368-3cb3c9c4010c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d42061747c4186871b00d96c3f0688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=350d4324-f44b-4edf-baac-dcbb16f11943,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:45Z,use_quota=True,user_id='dae1920f4acb45f3b1943b9cba43e080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec2190a-26e1-4a26-b00f-2ed568b8d4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec2190a-26e1-4a26-b00f-2ed568b8d4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30d5f1f-14d5-47ad-847f-b9bd2272e70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30d5f1f-14d5-47ad-847f-b9bd2272e70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b7532f3-eb2d-4395-8368-3cb3c9c4010c', 'volume_name': 'volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c', 'volume_size': 1, 'snapshot_id': '350d4324-f44b-4edf-baac-dcbb16f11943'}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b406082d-52ff-4a43-83ca-0796592733bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b406082d-52ff-4a43-83ca-0796592733bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf9afb0-3e4f-41e2-a211-371ea80e5cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:47 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Volume 5b7532f3-eb2d-4395-8368-3cb3c9c4010c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c', 'volume_size': 1, 'snapshot_id': '350d4324-f44b-4edf-baac-dcbb16f11943'} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.021s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-902234952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43958347-b5e8-46ef-b868-a56cdd6cb9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:42Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Creating volume 43958347-b5e8-46ef-b868-a56cdd6cb9f3 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:47 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:47 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=162, name=volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:47 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-9f94e8bd-7b2b-493c-84ee-193ab6ffd13e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created volume successfully. Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9174a92f-7537-4bd1-9a6b-5505cb4b89f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f150e7e-c556-4320-9725-37b0bae38eef', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cc0d9a-56d2-4586-bb9c-8f295387e2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3 1073741824" returned: 0 in 0.467s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:48 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume volume-6f150e7e-c556-4320-9725-37b0bae38eef (6f150e7e-c556-4320-9725-37b0bae38eef): created successfully Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cc0d9a-56d2-4586-bb9c-8f295387e2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (abaf6b41-b3ea-4330-b81c-72090426c448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3" returned: 0 in 0.326s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] <== create_volume: return (819ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.331s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1199976803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90332da-569d-47e1-9a6b-280ee6e82b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b23f0ea96f4c95ab0fd8fa1408ee7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:43Z,use_quota=True,user_id='2bef166a4dfd4149a96f4997230e8149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Creating volume c90332da-569d-47e1-9a6b-280ee6e82b97 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:48 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c90332da-569d-47e1-9a6b-280ee6e82b97 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:48 devstack quobyte-client[83739]: System call of process 99743 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:48 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-62176298-2010-4138-96aa-bf8b7081f6a1 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created volume successfully. Sep 17 18:49:48 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=163, name=volume-c90332da-569d-47e1-9a6b-280ee6e82b97, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=55,cinder:UPDATE=79,cinder:DELETE=11,cinder:INSERT=19 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece2443a-93cc-409d-af84-7499c993d786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ed5aaa-099c-48e1-9dc4-6d87c1c6e346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:SELECT=56,cinder:UPDATE=79,cinder:DELETE=9,cinder:INSERT=14 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c90332da-569d-47e1-9a6b-280ee6e82b97 1073741824" returned: 0 in 0.419s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c90332da-569d-47e1-9a6b-280ee6e82b97 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:48 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3 (43958347-b5e8-46ef-b868-a56cdd6cb9f3): created successfully Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ed5aaa-099c-48e1-9dc4-6d87c1c6e346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (49b14e0f-aeb7-4594-969d-4f348fbf55bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c90332da-569d-47e1-9a6b-280ee6e82b97" returned: 0 in 0.343s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] <== create_volume: return (785ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.801s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:49:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1002402051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1433ca62-b724-4727-86a7-823e9b494248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22309ddd954848bbb3706b8441660279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:49:46Z,use_quota=True,user_id='3fd1580ea5f347eebe7f91daa490f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Creating volume 1433ca62-b724-4727-86a7-823e9b494248 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:49 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:49 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=164, name=volume-1433ca62-b724-4727-86a7-823e9b494248, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3395e69b-d8b7-4daf-a73e-5478eded39b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90332da-569d-47e1-9a6b-280ee6e82b97', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0be38b-0f2b-4a32-9c49-0b2a5705c64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:49 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-99d585cf-075f-42c5-83cd-7df52de8a0ea tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created volume successfully. Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248 1073741824" returned: 0 in 0.457s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:49 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume volume-c90332da-569d-47e1-9a6b-280ee6e82b97 (c90332da-569d-47e1-9a6b-280ee6e82b97): created successfully Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0be38b-0f2b-4a32-9c49-0b2a5705c64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Flow 'volume_create_manager' (4b7d1cd1-5ed3-416e-aa32-f52f7412e12c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248" returned: 0 in 0.295s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] <== create_volume: return (776ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.089s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:49 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "cinder-quobyte-350d4324-f44b-4edf-baac-dcbb16f11943-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" by "_create_volume_from_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:50 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-32e3d45e-ed12-4b03-baeb-91eff56074e5 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created volume successfully. Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ddf8ac-5e42-4915-a580-9943873ff9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1433ca62-b724-4727-86a7-823e9b494248', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ae84ca-3fa1-4223-b1b2-ab26960dcd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:50 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Volume volume-1433ca62-b724-4727-86a7-823e9b494248 (1433ca62-b724-4727-86a7-823e9b494248): created successfully Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ae84ca-3fa1-4223-b1b2-ab26960dcd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Flow 'volume_create_manager' (63a3a8fd-b04e-4a6e-bc40-c4b29c22b1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-350d4324-f44b-4edf-baac-dcbb16f11943-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" acquired by "_create_volume_from_snapshot" :: waited 0.123s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Creating volume 5b7532f3-eb2d-4395-8368-3cb3c9c4010c from snapshot 350d4324-f44b-4edf-baac-dcbb16f11943 {{(pid=83736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "cinder-quobyte-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" by "_copy_volume_from_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] snapshot: 350d4324-f44b-4edf-baac-dcbb16f11943, volume: 5b7532f3-eb2d-4395-8368-3cb3c9c4010c, {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:50 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-9adc2516-5fee-429d-8027-55f5a85ccb39 tempest-CinderUnicodeTest-2037868990 None] Created volume successfully. Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed2e3a9-2aa8-43ae-b1b6-1e7ff256d927]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943" returned: 0 in 0.441s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f65125c8-bc9f-4911-a05d-83a13a435260(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Creating direct copy from snapshot {{(pid=83736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d73b66b-84f3-4cd5-94bc-a73a71caada3]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:50 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-c90332da-569d-47e1-9a6b-280ee6e82b97-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:51 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-c90332da-569d-47e1-9a6b-280ee6e82b97-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:51 devstack quobyte-client[83739]: System call of process 99754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:51 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:51 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-quobyte-c90332da-569d-47e1-9a6b-280ee6e82b97" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:51 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-c90332da-569d-47e1-9a6b-280ee6e82b97" acquired by "delete_volume" :: waited 0.021s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260" returned: 0 in 0.625s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:51 devstack cinder-volume[83736]: DEBUG cinder.utils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c not found in is_blk_device check {{(pid=83736) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 17 18:49:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:51 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[58834c96-6e7b-4ccc-9317-aa77f750a676]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:51 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c90332da-569d-47e1-9a6b-280ee6e82b97 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:51 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=165, name=volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:49:52 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:52 devstack quobyte-client[83739]: System call of process 99760 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:49:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c90332da-569d-47e1-9a6b-280ee6e82b97" returned: 0 in 1.272s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:52 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c90332da-569d-47e1-9a6b-280ee6e82b97 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:53 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c90332da-569d-47e1-9a6b-280ee6e82b97" returned: 0 in 0.433s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:53 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-c90332da-569d-47e1-9a6b-280ee6e82b97" released by "delete_volume" :: held 2.492s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:54 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created reservations ['3557e799-d851-40c5-95a7-486f4459e25d', 'b76d5302-0d71-4017-a85d-d403b84fbea1', 'de537ef3-30e5-45a9-a99f-fa7cc7e6c9ba', 'ed274358-9531-4040-af08-508b3d86ce3d'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:49:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:54 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:54 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:55 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-43958347-b5e8-46ef-b868-a56cdd6cb9f3-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:56 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 1.163s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:56 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:49:56 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Deleted volume successfully. Sep 17 18:49:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-43958347-b5e8-46ef-b868-a56cdd6cb9f3-delete_volume" acquired by "delete_volume" :: waited 0.590s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a41a6d4f-1634-4992-9e20-393b76e9b1ca tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-c90332da-569d-47e1-9a6b-280ee6e82b97-delete_volume" released by "delete_volume" :: held 5.293s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:56 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:49:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-quobyte-43958347-b5e8-46ef-b868-a56cdd6cb9f3" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:49:56 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-43958347-b5e8-46ef-b868-a56cdd6cb9f3" acquired by "delete_volume" :: waited 0.062s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:49:56 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7914a7-e945-4180-bf4d-396e8fd243be]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:57 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" returned: 0 in 6.561s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:58 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2f6700-edf2-4404-8cf0-fd424a06103b]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3" returned: 0 in 1.273s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-43958347-b5e8-46ef-b868-a56cdd6cb9f3" returned: 0 in 0.098s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:58 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-43958347-b5e8-46ef-b868-a56cdd6cb9f3" released by "delete_volume" :: held 1.615s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260" returned: 0 in 0.736s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:58 devstack cinder-volume[83736]: DEBUG cinder.image.image_utils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c {{(pid=83736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 18:49:58 devstack cinder-volume[83736]: INFO cinder.image.image_utils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Converted 1024.00 MB image at 155.37 MB/s Sep 17 18:49:58 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:49:58 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:58 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created reservations ['049ec27f-9f97-4a4e-b7c7-ace5f7c2f721', '1b7d1c9b-f95d-4509-916a-47dae0d2c401', '8f8f5858-f49e-4b02-b016-41a0993f46db', 'b678e1ac-ba34-416f-ab2f-5020f8395153'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" returned: 0 in 0.335s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" released by "_copy_volume_from_snapshot" :: held 9.072s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-350d4324-f44b-4edf-baac-dcbb16f11943-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" released by "_create_volume_from_snapshot" :: held 9.135s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.274s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.914s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Creating offline snapshot 6c7e57ac-7046-417c-bf07-9884924534c0 of volume 1433ca62-b724-4727-86a7-823e9b494248 {{(pid=83736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53bbb51-6099-4502-9d81-024408217761]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf9afb0-3e4f-41e2-a211-371ea80e5cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c', 'volume_size': 1, 'snapshot_id': '350d4324-f44b-4edf-baac-dcbb16f11943'}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541f331b-dacd-4b25-936f-30c8d6b0e8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:49:59 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Volume volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c (5b7532f3-eb2d-4395-8368-3cb3c9c4010c): created successfully Sep 17 18:49:59 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541f331b-dacd-4b25-936f-30c8d6b0e8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:00 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Flow 'volume_create_manager' (c5643321-518b-42d0-8dcd-86e459c78213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:00 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-6f150e7e-c556-4320-9725-37b0bae38eef-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248" returned: 0 in 0.898s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:00 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d8c5efd8-2cd2-4850-a66e-5719e36f6d2e tempest-SnapshotDependencyTests-682388138 None] Created volume successfully. Sep 17 18:50:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0 1G {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.586s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:00 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=166, name=volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:50:00 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:00 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "cinder-350d4324-f44b-4edf-baac-dcbb16f11943-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:00 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Deleted volume successfully. Sep 17 18:50:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0 1G" returned: 0 in 0.466s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:00 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1433ca62-b724-4727-86a7-823e9b494248 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:00 devstack quobyte-client[83739]: System call of process 99789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:50:00 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-6f150e7e-c556-4320-9725-37b0bae38eef-delete_volume" acquired by "delete_volume" :: waited 0.684s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-350d4324-f44b-4edf-baac-dcbb16f11943-delete_snapshot" acquired by "delete_snapshot" :: waited 0.454s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:01 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "cinder-quobyte-f65125c8-bc9f-4911-a05d-83a13a435260" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-d0e06d27-72bb-4308-8ef2-c33cbff2aad3 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-43958347-b5e8-46ef-b868-a56cdd6cb9f3-delete_volume" released by "delete_volume" :: held 4.903s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] CMD "qemu-img rebase -u -b volume-1433ca62-b724-4727-86a7-823e9b494248 -F qcow2 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0" returned: 0 in 0.433s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0 is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-f65125c8-bc9f-4911-a05d-83a13a435260" acquired by "delete_snapshot" :: waited 0.393s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "cinder-quobyte-350d4324-f44b-4edf-baac-dcbb16f11943" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0" returned: 0 in 0.419s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Setting permissions: /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248 -> 1000:1000 {{(pid=83736) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:01 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-quobyte-6f150e7e-c556-4320-9725-37b0bae38eef" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-350d4324-f44b-4edf-baac-dcbb16f11943" acquired by "_delete_snapshot" :: waited 0.354s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Deleting offline snapshot 350d4324-f44b-4edf-baac-dcbb16f11943 of volume f65125c8-bc9f-4911-a05d-83a13a435260 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] snapshot_file for this snap is: volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0" returned: 0 in 0.298s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:01 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[02169c3c-1933-4e88-aea6-f5a0f3ffb3cc]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-6f150e7e-c556-4320-9725-37b0bae38eef" acquired by "delete_volume" :: waited 0.365s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f501eb3c-bd07-4f70-bab6-847aaafb38c5]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6f150e7e-c556-4320-9725-37b0bae38eef {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.info" returned: 0 in 0.448s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] File path /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.info is being set with permissions: 660 {{(pid=83736) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.info {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.info" returned: 0 in 0.152s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.444s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943" returned: 0 in 0.874s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:02 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f65125c8-bc9f-4911-a05d-83a13a435260(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:50:03 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-af381c9f-8596-4a94-9d9c-a7c44411de5b tempest-CinderUnicodeTest-2037868990 None] Create snapshot completed successfully Sep 17 18:50:03 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb5897e-be82-49ec-a5b7-29e06caf3872]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6f150e7e-c556-4320-9725-37b0bae38eef" returned: 0 in 0.845s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6f150e7e-c556-4320-9725-37b0bae38eef {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6f150e7e-c556-4320-9725-37b0bae38eef" returned: 0 in 0.101s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:03 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-6f150e7e-c556-4320-9725-37b0bae38eef" released by "delete_volume" :: held 1.213s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260" returned: 0 in 0.626s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:03 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943" returned: 0 in 0.369s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260.350d4324-f44b-4edf-baac-dcbb16f11943" returned: 0 in 0.214s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "cinder-6c7e57ac-7046-417c-bf07-9884924534c0-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-350d4324-f44b-4edf-baac-dcbb16f11943" released by "_delete_snapshot" :: held 2.560s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created reservations ['7167638b-fc02-4341-9a27-647abebb6733', 'f6e023a7-acb7-472a-8280-c65b0bb8f677', '2ddbbc6b-6c36-46fc-9cfa-aefc4896cd9d', '927136d4-4f24-4fd6-b650-704fd4dfbbc3'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-f65125c8-bc9f-4911-a05d-83a13a435260" released by "delete_snapshot" :: held 3.059s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-6c7e57ac-7046-417c-bf07-9884924534c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.225s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:04 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "cinder-quobyte-1433ca62-b724-4727-86a7-823e9b494248" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-quobyte-1433ca62-b724-4727-86a7-823e9b494248" acquired by "delete_snapshot" :: waited 0.068s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "cinder-quobyte-6c7e57ac-7046-417c-bf07-9884924534c0" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:04 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-quobyte-6c7e57ac-7046-417c-bf07-9884924534c0" acquired by "_delete_snapshot" :: waited 0.252s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Deleting offline snapshot 6c7e57ac-7046-417c-bf07-9884924534c0 of volume 1433ca62-b724-4727-86a7-823e9b494248 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] snapshot_file for this snap is: volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[877d0260-d1e0-4af6-b226-31f8f08c8b39]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.517s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:05 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Deleted volume successfully. Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Created reservations ['c841eaa8-3a17-40e9-98ad-2cfb6ee06dd0', 'baf55444-8237-4402-9461-3bf8f3921096', 'df23e5ed-8d02-4ad8-9f28-2cd9c96dfa6b', '54f71b4f-b60b-4a9b-839d-eb9e5ce15f3f'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-4e114020-c3fe-4538-bb1f-088dd5fba76e tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-6f150e7e-c556-4320-9725-37b0bae38eef-delete_volume" released by "delete_volume" :: held 4.657s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:05 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Delete snapshot completed successfully. Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e98a9148-8870-4f54-92a3-1224fb4a8deb tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-350d4324-f44b-4edf-baac-dcbb16f11943-delete_snapshot" released by "delete_snapshot" :: held 4.604s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:05 devstack quobyte-client[83739]: System call of process 99813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0" returned: 0 in 0.668s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1433ca62-b724-4727-86a7-823e9b494248(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-8a10f72c-2369-45fc-858d-2e60ce91e650-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34d2ec3-ab52-4f10-bf81-133d1d7fdad6]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:05 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "cinder-f65125c8-bc9f-4911-a05d-83a13a435260-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-8a10f72c-2369-45fc-858d-2e60ce91e650-delete_volume" acquired by "delete_volume" :: waited 0.341s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-f65125c8-bc9f-4911-a05d-83a13a435260-delete_volume" acquired by "delete_volume" :: waited 0.300s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:06 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-quobyte-8a10f72c-2369-45fc-858d-2e60ce91e650" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:06 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "cinder-quobyte-f65125c8-bc9f-4911-a05d-83a13a435260" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248" returned: 0 in 0.600s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-f65125c8-bc9f-4911-a05d-83a13a435260" acquired by "delete_volume" :: waited 0.241s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-8a10f72c-2369-45fc-858d-2e60ce91e650" acquired by "delete_volume" :: waited 0.298s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0643f0ab-7ad3-4ce3-a8b1-05495a3cc288]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f62ca1-bba4-4dd9-b57c-c82d90beabb5]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:06 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8a10f72c-2369-45fc-858d-2e60ce91e650 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0" returned: 0 in 0.541s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248.6c7e57ac-7046-417c-bf07-9884924534c0" returned: 0 in 0.148s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:07 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-quobyte-6c7e57ac-7046-417c-bf07-9884924534c0" released by "_delete_snapshot" :: held 2.344s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260" returned: 0 in 0.609s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:07 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-quobyte-1433ca62-b724-4727-86a7-823e9b494248" released by "delete_snapshot" :: held 2.738s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f65125c8-bc9f-4911-a05d-83a13a435260" returned: 0 in 0.413s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8a10f72c-2369-45fc-858d-2e60ce91e650" returned: 0 in 0.973s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:07 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8a10f72c-2369-45fc-858d-2e60ce91e650 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-f65125c8-bc9f-4911-a05d-83a13a435260" released by "delete_volume" :: held 1.398s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-8a10f72c-2369-45fc-858d-2e60ce91e650" returned: 0 in 0.318s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-8a10f72c-2369-45fc-858d-2e60ce91e650" released by "delete_volume" :: held 1.440s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Created reservations ['c4f9056a-3be0-4912-abe2-c5f7a104bd4e', 'fbb8c53a-5ee3-40e0-9504-10c0eca6c377', '956171ae-9981-41c3-84c3-18dccad93614', 'e1138d42-ab75-4073-b913-37f13a8a953a'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Created reservations ['e6bff61e-f1b1-43e7-b46f-dbda4e9e1008', '9b6e7d67-da8f-4007-968a-762b06abd06d', 'c693d85e-75b3-4bd6-8acc-49e186fee281', '72af0106-1785-4a0a-a08c-779d858c1f62'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created reservations ['104f1692-8092-46aa-9e33-2b7bae3ec89f', '4eb52fc9-03fc-47e9-8877-31f5e285bc9f', 'cdad66e1-6634-4c5c-a711-6ad9608de68e', '18585ef2-68a5-4381-8919-04ab847f52a4'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:08 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Delete snapshot completed successfully. Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:08 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "cinder-1433ca62-b724-4727-86a7-823e9b494248-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-12074857-9ccf-40c5-acb0-f75012a4eeef tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-6c7e57ac-7046-417c-bf07-9884924534c0-delete_snapshot" released by "delete_snapshot" :: held 4.736s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-2bd00202-d834-42ba-922a-443ec6d40b64-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.551s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "cinder-5b7532f3-eb2d-4395-8368-3cb3c9c4010c-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-1433ca62-b724-4727-86a7-823e9b494248-delete_volume" acquired by "delete_volume" :: waited 0.249s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 1.017s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:09 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Deleted volume successfully. Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-2bd00202-d834-42ba-922a-443ec6d40b64-delete_volume" acquired by "delete_volume" :: waited 0.248s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-5b7532f3-eb2d-4395-8368-3cb3c9c4010c-delete_volume" acquired by "delete_volume" :: waited 0.295s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:09 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "cinder-quobyte-1433ca62-b724-4727-86a7-823e9b494248" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fab9d06e-1797-422a-a81e-e1252523c660 tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-f65125c8-bc9f-4911-a05d-83a13a435260-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:09 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Deleted volume successfully. Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-quobyte-1433ca62-b724-4727-86a7-823e9b494248" acquired by "delete_volume" :: waited 0.065s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:09 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-quobyte-2bd00202-d834-42ba-922a-443ec6d40b64" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfa9dc3-5fae-4bae-b062-f1e17c4bc698]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:09 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:10 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "cinder-quobyte-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-2eced12f-d762-4630-8aba-eb9afa7770db tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-8a10f72c-2369-45fc-858d-2e60ce91e650-delete_volume" released by "delete_volume" :: held 4.190s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-2bd00202-d834-42ba-922a-443ec6d40b64" acquired by "delete_volume" :: waited 0.503s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:10 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" acquired by "delete_volume" :: waited 0.086s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:10 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eea928-234a-4474-8bca-65f2342cb9ba]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2bd00202-d834-42ba-922a-443ec6d40b64 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:10 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb109c-17c1-4f9a-b2b5-7e480a37c25a]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248" returned: 0 in 1.035s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:10 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-1433ca62-b724-4727-86a7-823e9b494248" returned: 0 in 0.169s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2bd00202-d834-42ba-922a-443ec6d40b64" returned: 0 in 0.803s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:11 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-quobyte-1433ca62-b724-4727-86a7-823e9b494248" released by "delete_volume" :: held 1.421s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2bd00202-d834-42ba-922a-443ec6d40b64 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" returned: 0 in 0.965s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:11 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2bd00202-d834-42ba-922a-443ec6d40b64" returned: 0 in 0.371s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-2bd00202-d834-42ba-922a-443ec6d40b64" released by "delete_volume" :: held 1.753s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" returned: 0 in 0.395s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-quobyte-5b7532f3-eb2d-4395-8368-3cb3c9c4010c" released by "delete_volume" :: held 1.779s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Created reservations ['e763d244-ef8f-465a-9d63-03148ea9f1bf', 'ccc67505-43f1-4f72-91f4-359bcae9d99b', '6ce9ea2c-9ccf-412d-b9ab-4c04d96dd956', '6bd078a3-484c-4f81-8789-24e260c87bb7'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created reservations ['24712ee1-96cb-461a-a249-465dbaf9b7e7', '632161a8-af88-40c5-9fe3-eb2d3410c362', '5976467e-ea90-46de-a398-d16f3c71355f', '0f6bba21-0f6f-4afc-a38e-39dc748f4765'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Created reservations ['ae8ab2fd-eaa3-44f6-8a4d-eb2860f82198', '888c0991-b549-44d1-9728-0a57dc358bb0', '00708d48-c9f5-48b2-913a-e70787d0ce2a', '8f3ccf7d-1093-4028-ac7a-1fd5528b77a3'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.351s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:12 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Deleted volume successfully. Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-70fa3915-ef90-4571-84e3-9fe82bd5f27c tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-1433ca62-b724-4727-86a7-823e9b494248-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:12 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-df6391f5-792c-4c39-8d9a-c90f6d189c40-delete_snapshot" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "cinder-4aaa3428-0ac1-4f35-be89-c310d2e1155c-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.736s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.313s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-df6391f5-792c-4c39-8d9a-c90f6d189c40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.430s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:13 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-quobyte-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf" by "delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-4aaa3428-0ac1-4f35-be89-c310d2e1155c-delete_volume" acquired by "delete_volume" :: waited 0.200s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:13 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Deleted volume successfully. Sep 17 18:50:13 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Deleted volume successfully. Sep 17 18:50:13 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "cinder-quobyte-4aaa3428-0ac1-4f35-be89-c310d2e1155c" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf" acquired by "delete_snapshot" :: waited 0.219s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-quobyte-df6391f5-792c-4c39-8d9a-c90f6d189c40" by "_delete_snapshot" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-a20f0eb0-0841-44bb-8c8b-8612bc0c142f tempest-SnapshotDependencyTests-682388138 None] Lock "cinder-5b7532f3-eb2d-4395-8368-3cb3c9c4010c-delete_volume" released by "delete_volume" :: held 4.204s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-fcbc6eb1-4561-4dd7-8fd8-b7fcfccbbcf2 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-2bd00202-d834-42ba-922a-443ec6d40b64-delete_volume" released by "delete_volume" :: held 4.278s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:13 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-quobyte-4aaa3428-0ac1-4f35-be89-c310d2e1155c" acquired by "delete_volume" :: waited 0.041s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:14 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9c0470-2f24-45c1-9d5d-62ade6db25b2]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:14 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-df6391f5-792c-4c39-8d9a-c90f6d189c40" acquired by "_delete_snapshot" :: waited 0.267s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Deleting offline snapshot df6391f5-792c-4c39-8d9a-c90f6d189c40 of volume 6056aecc-77bd-4bf0-aa22-ab4e47bb86cf {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 18:50:14 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] snapshot_file for this snap is: volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40 {{(pid=83736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 18:50:14 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dfc68e-0587-467d-bdcd-d0fcab42365e]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c" returned: 0 in 0.780s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:14 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-4aaa3428-0ac1-4f35-be89-c310d2e1155c" returned: 0 in 0.137s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40" returned: 0 in 0.679s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:15 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 18:50:15 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b4cdff-74dd-4928-9607-ddddbce9508f]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:15 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-quobyte-4aaa3428-0ac1-4f35-be89-c310d2e1155c" released by "delete_volume" :: held 1.236s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:15 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Created reservations ['fdd96007-79e1-425c-a080-a37f364d126d', 'ece71591-d103-4cc3-a3d4-97177f602ede', '3b6b7b5e-facc-48d2-bb7a-9ee4da55dced', 'b14ee6c1-7cd1-44e0-8929-ab4982f64c60'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:15 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf" returned: 0 in 0.875s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:16 devstack quobyte-client[83739]: System call of process 99863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:50:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:16 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40" returned: 0 in 0.785s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:16 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.267s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:17 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Deleted volume successfully. Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf.df6391f5-792c-4c39-8d9a-c90f6d189c40" returned: 0 in 0.348s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-df6391f5-792c-4c39-8d9a-c90f6d189c40" released by "_delete_snapshot" :: held 3.117s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf" released by "delete_snapshot" :: held 3.399s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-e39c9a85-6b57-4ce2-bcc5-25f7664c0382 tempest-CinderUnicodeTest-2037868990 None] Lock "cinder-4aaa3428-0ac1-4f35-be89-c310d2e1155c-delete_volume" released by "delete_volume" :: held 3.662s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:18 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.495s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:18 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:18 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created reservations ['41dc4201-3b97-469a-ac5d-c97dd0724271', '9facc6be-18f0-42f0-8ef6-fecf9b9ac2b2', 'f5a623c8-fcb4-43b4-9be5-2d9859934fe7', 'fd2b2c56-22dd-4b73-aee9-0b92f9dd4091'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:18 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Delete snapshot completed successfully. Sep 17 18:50:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-aacf18f6-ba77-4d9f-a6ea-9fd66e371d6a tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-df6391f5-792c-4c39-8d9a-c90f6d189c40-delete_snapshot" released by "delete_snapshot" :: held 4.774s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:18 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:19 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "cinder-quobyte-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:19 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf" acquired by "delete_volume" :: waited 0.036s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:19 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2967b0-db73-41f4-8922-8d3581512bec]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:19 devstack quobyte-client[83739]: System call of process 99870 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:50:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf" returned: 0 in 0.592s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:19 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:20 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf" returned: 0 in 0.151s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:20 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-quobyte-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf" released by "delete_volume" :: held 1.051s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:20 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Created reservations ['09b680c8-08eb-4f84-bb0f-dd81c9e1ea30', 'e66a0491-a5c1-4ceb-9ae1-b7fb2eb1b377', 'a8f42603-d4bc-4014-8d04-47bb34b94257', '95d5d6c3-8bf3-42d7-ab82-95a985f7106e'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:21 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:21 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.145s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:21 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:21 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Deleted volume successfully. Sep 17 18:50:21 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f180dbb0-9785-4590-89c8-210e1d76e140 tempest-CreateVolumesFromSnapshotTest-1776211746 None] Lock "cinder-6056aecc-77bd-4bf0-aa22-ab4e47bb86cf-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:25 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:25 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:50:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (720b116a-53d1-4759-84a2-001ef147a906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:25 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e864a76d-e9b6-4f0d-8984-f1a118c2c4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e864a76d-e9b6-4f0d-8984-f1a118c2c4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-408426570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b315cb6-d168-4066-a8f6-f175634b7a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:26Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75a8536-7811-490a-8b80-7c6fcde76d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75a8536-7811-490a-8b80-7c6fcde76d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1196ea-2dfd-47aa-a3a3-3358e5436303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1196ea-2dfd-47aa-a3a3-3358e5436303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b315cb6-d168-4066-a8f6-f175634b7a41', 'volume_name': 'volume-3b315cb6-d168-4066-a8f6-f175634b7a41', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5af5cc-60b1-49c1-bccf-c8b67490c6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5af5cc-60b1-49c1-bccf-c8b67490c6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5aeeab-f377-4525-8547-490d95667566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:26 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume 3b315cb6-d168-4066-a8f6-f175634b7a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b315cb6-d168-4066-a8f6-f175634b7a41', 'volume_size': 1} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-408426570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b315cb6-d168-4066-a8f6-f175634b7a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:26Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Creating volume 3b315cb6-d168-4066-a8f6-f175634b7a41 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:50:26 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b315cb6-d168-4066-a8f6-f175634b7a41 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:26 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=168, name=volume-3b315cb6-d168-4066-a8f6-f175634b7a41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:50:26 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b315cb6-d168-4066-a8f6-f175634b7a41 1073741824" returned: 0 in 0.766s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b315cb6-d168-4066-a8f6-f175634b7a41 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b315cb6-d168-4066-a8f6-f175634b7a41" returned: 0 in 0.123s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:27 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] <== create_volume: return (1009ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:50:27 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5aeeab-f377-4525-8547-490d95667566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b315cb6-d168-4066-a8f6-f175634b7a41', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6742b5f0-48c3-4f36-a7d8-270b5f1c75b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:27 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume volume-3b315cb6-d168-4066-a8f6-f175634b7a41 (3b315cb6-d168-4066-a8f6-f175634b7a41): created successfully Sep 17 18:50:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6742b5f0-48c3-4f36-a7d8-270b5f1c75b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:27 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (720b116a-53d1-4759-84a2-001ef147a906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:27 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-f2be1130-fb42-4d75-acbe-95a8255cb247 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created volume successfully. Sep 17 18:50:28 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (d945b3e2-2d20-4ceb-97da-106a741068f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83473d5d-922e-4e6f-8584-1e19a7d3c956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83473d5d-922e-4e6f-8584-1e19a7d3c956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1042385653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee1f3b7-252d-4305-9e9b-dff0c623b46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:28Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c03862d-b9db-4360-b161-0cd3710d9522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c03862d-b9db-4360-b161-0cd3710d9522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6814e95-b295-4db0-8d30-707a1470d201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6814e95-b295-4db0-8d30-707a1470d201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee1f3b7-252d-4305-9e9b-dff0c623b46a', 'volume_name': 'volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66adaa85-48a1-40dc-8090-6c7cec60cf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66adaa85-48a1-40dc-8090-6c7cec60cf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51fb947-031d-455e-bb46-7c3ed5c3026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:28 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume 2ee1f3b7-252d-4305-9e9b-dff0c623b46a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a', 'volume_size': 1} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1042385653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee1f3b7-252d-4305-9e9b-dff0c623b46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:28Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Creating volume 2ee1f3b7-252d-4305-9e9b-dff0c623b46a {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:50:28 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:50:28 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:28 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=169, name=volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:50:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a 1073741824" returned: 0 in 0.511s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a" returned: 0 in 0.204s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:29 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] <== create_volume: return (762ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:50:29 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:29 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:29 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:50:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (b47d4f78-4e83-4fec-bea1-e10a80c3acd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:29 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4eb723d-e177-4c33-b8b5-90c86af6404f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51fb947-031d-455e-bb46-7c3ed5c3026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5f110b-d946-4553-b945-0006fe8e449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4eb723d-e177-4c33-b8b5-90c86af6404f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317697425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:28Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c06c6e-1cd2-4a0e-b5ef-9d035d6a60c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c06c6e-1cd2-4a0e-b5ef-9d035d6a60c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729bb0f5-0cdc-418e-8c06-e5c76f28dd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729bb0f5-0cdc-418e-8c06-e5c76f28dd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6', 'volume_name': 'volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22906c14-53ff-4527-8cc4-3066d369dfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22906c14-53ff-4527-8cc4-3066d369dfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f723e02-bce2-4ff9-962c-2c7427c92199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:31 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6', 'volume_size': 1} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317697425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:28Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Creating volume c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:50:31 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:31 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=170, name=volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6 1073741824" returned: 0 in 0.345s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:31 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a (2ee1f3b7-252d-4305-9e9b-dff0c623b46a): created successfully Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5f110b-d946-4553-b945-0006fe8e449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (d945b3e2-2d20-4ceb-97da-106a741068f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6" returned: 0 in 0.433s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] <== create_volume: return (837ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:50:31 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:31 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-d4a9cbbc-81e5-4b74-a12b-56e4d2e45135 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created volume successfully. Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f723e02-bce2-4ff9-962c-2c7427c92199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2213bc91-1036-40fc-ad57-c2c25e63d609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:32 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (bd82913c-30b8-4f06-b922-52433e71a864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d24619-ed5c-4a4e-b742-a0914e8d6c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:32 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6 (c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6): created successfully Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2213bc91-1036-40fc-ad57-c2c25e63d609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (b47d4f78-4e83-4fec-bea1-e10a80c3acd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d24619-ed5c-4a4e-b742-a0914e8d6c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607839547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaaef65-a8f6-4aae-b905-963c406a92ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:31Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56ba3e6-89f3-4594-9487-a04878ba4a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56ba3e6-89f3-4594-9487-a04878ba4a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13892a82-062c-4612-bab2-4082819158d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13892a82-062c-4612-bab2-4082819158d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eaaef65-a8f6-4aae-b905-963c406a92ee', 'volume_name': 'volume-0eaaef65-a8f6-4aae-b905-963c406a92ee', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be38f96-0c06-4d3d-bcb3-3a1cdd1e24ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be38f96-0c06-4d3d-bcb3-3a1cdd1e24ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb8d401-d951-4983-82ee-c53e3a289f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:32 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume 0eaaef65-a8f6-4aae-b905-963c406a92ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eaaef65-a8f6-4aae-b905-963c406a92ee', 'volume_size': 1} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607839547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaaef65-a8f6-4aae-b905-963c406a92ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:31Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Creating volume 0eaaef65-a8f6-4aae-b905-963c406a92ee {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:50:32 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0eaaef65-a8f6-4aae-b905-963c406a92ee 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:32 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=171, name=volume-0eaaef65-a8f6-4aae-b905-963c406a92ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:50:32 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-366e55d9-86e1-4085-8e71-f05fbb0ce099 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created volume successfully. Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0eaaef65-a8f6-4aae-b905-963c406a92ee 1073741824" returned: 0 in 0.564s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:32 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0eaaef65-a8f6-4aae-b905-963c406a92ee {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:33 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (8e2850a6-a9e1-4685-905c-0c3a6c4fd93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2011a601-829e-4136-86b6-875c2c4e0a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2011a601-829e-4136-86b6-875c2c4e0a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1563859507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0789ff9-ef93-4508-891f-05651669d5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:32Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12a6653-6cb2-4744-99a4-67b829de3d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12a6653-6cb2-4744-99a4-67b829de3d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7629ad3d-f68a-44ab-849e-5e68656c234c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7629ad3d-f68a-44ab-849e-5e68656c234c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0789ff9-ef93-4508-891f-05651669d5ff', 'volume_name': 'volume-a0789ff9-ef93-4508-891f-05651669d5ff', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba79e7a-8ab7-42cd-ae95-d005204c807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba79e7a-8ab7-42cd-ae95-d005204c807c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d164e79d-dad8-462f-a8c6-8dd2982276db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:33 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume a0789ff9-ef93-4508-891f-05651669d5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0789ff9-ef93-4508-891f-05651669d5ff', 'volume_size': 1} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0eaaef65-a8f6-4aae-b905-963c406a92ee" returned: 0 in 0.686s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] <== create_volume: return (1278ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.046s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1563859507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0789ff9-ef93-4508-891f-05651669d5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:32Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Creating volume a0789ff9-ef93-4508-891f-05651669d5ff {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:50:33 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:50:33 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0789ff9-ef93-4508-891f-05651669d5ff 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:33 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=172, name=volume-a0789ff9-ef93-4508-891f-05651669d5ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb8d401-d951-4983-82ee-c53e3a289f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eaaef65-a8f6-4aae-b905-963c406a92ee', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a300df7-a4bd-4f60-97e5-d4d73084ea62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:34 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (e31fe36d-d0ae-41df-9a33-d47f8a8d0f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e760f008-d7fe-4125-b70a-9cd18a3eb8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:34 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume volume-0eaaef65-a8f6-4aae-b905-963c406a92ee (0eaaef65-a8f6-4aae-b905-963c406a92ee): created successfully Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a300df7-a4bd-4f60-97e5-d4d73084ea62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (bd82913c-30b8-4f06-b922-52433e71a864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0789ff9-ef93-4508-891f-05651669d5ff 1073741824" returned: 0 in 0.664s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0789ff9-ef93-4508-891f-05651669d5ff {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:34 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-51f2e03a-f22d-4eaf-939f-d028a0fecfb5 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created volume successfully. Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e760f008-d7fe-4125-b70a-9cd18a3eb8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-339134923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f845de2a-2396-4c64-8d99-6e037e48fae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:33Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5264ef21-5c46-4e3c-be20-56c5936a7dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5264ef21-5c46-4e3c-be20-56c5936a7dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38f6ab9-0738-41a6-ad97-c9e0fd205d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38f6ab9-0738-41a6-ad97-c9e0fd205d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f845de2a-2396-4c64-8d99-6e037e48fae8', 'volume_name': 'volume-f845de2a-2396-4c64-8d99-6e037e48fae8', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a2d74e-2c18-4b6b-9fe2-08fcb3b78f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a2d74e-2c18-4b6b-9fe2-08fcb3b78f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95c9768-abeb-443e-b9b0-40f2b34e1f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:34 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume f845de2a-2396-4c64-8d99-6e037e48fae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f845de2a-2396-4c64-8d99-6e037e48fae8', 'volume_size': 1} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0789ff9-ef93-4508-891f-05651669d5ff" returned: 0 in 0.414s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] <== create_volume: return (1099ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.071s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T16:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-339134923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f845de2a-2396-4c64-8d99-6e037e48fae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b03d245e7e4922b174ccb2e14cbedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T16:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T16:50:33Z,use_quota=True,user_id='dcb983cf0aff46078b5323e4f4e5d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc790fb-f11e-47cf-8288-4a50cb6009cd),volume_type_id=0cc790fb-f11e-47cf-8288-4a50cb6009cd)}" {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.remotefs [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Creating volume f845de2a-2396-4c64-8d99-6e037e48fae8 {{(pid=83736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Selected 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a as target Quobyte volume. {{(pid=83736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 18:50:34 devstack cinder-volume[83736]: INFO cinder.volume.drivers.remotefs [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] casted to 10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a Sep 17 18:50:34 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f845de2a-2396-4c64-8d99-6e037e48fae8 1073741824 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:34 devstack quobyte-client[83739]: System call of process 99937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 18:50:35 devstack quobyte-client[83739]: The server volume:b747059c-dbbb-4527-95f0-7aac07684036@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b747059c-dbbb-4527-95f0-7aac07684036, inode=173, name=volume-f845de2a-2396-4c64-8d99-6e037e48fae8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.201), requestorAccessMask=0 Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d164e79d-dad8-462f-a8c6-8dd2982276db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0789ff9-ef93-4508-891f-05651669d5ff', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735780e5-9c87-4ec3-87dc-865435cf4110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:35 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume volume-a0789ff9-ef93-4508-891f-05651669d5ff (a0789ff9-ef93-4508-891f-05651669d5ff): created successfully Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735780e5-9c87-4ec3-87dc-865435cf4110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (8e2850a6-a9e1-4685-905c-0c3a6c4fd93b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f845de2a-2396-4c64-8d99-6e037e48fae8 1073741824" returned: 0 in 0.428s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f845de2a-2396-4c64-8d99-6e037e48fae8 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-9c69b8d4-437e-4127-a9ed-c56215b1b163 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created volume successfully. Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f845de2a-2396-4c64-8d99-6e037e48fae8" returned: 0 in 0.231s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] <== create_volume: return (689ms) {'provider_location': '10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'} {{(pid=83736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95c9768-abeb-443e-b9b0-40f2b34e1f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f845de2a-2396-4c64-8d99-6e037e48fae8', 'volume_size': 1}' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548d10b2-5af7-451a-bc6f-3e4debe0b291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 18:50:35 devstack cinder-volume[83736]: INFO cinder.volume.flows.manager.create_volume [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume volume-f845de2a-2396-4c64-8d99-6e037e48fae8 (f845de2a-2396-4c64-8d99-6e037e48fae8): created successfully Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548d10b2-5af7-451a-bc6f-3e4debe0b291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Flow 'volume_create_manager' (e31fe36d-d0ae-41df-9a33-d47f8a8d0f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 18:50:35 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-1b82187a-c00e-4d36-b7ae-49a5a88520a4 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created volume successfully. Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-f845de2a-2396-4c64-8d99-6e037e48fae8-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:35 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-f845de2a-2396-4c64-8d99-6e037e48fae8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:36 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-quobyte-f845de2a-2396-4c64-8d99-6e037e48fae8" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-f845de2a-2396-4c64-8d99-6e037e48fae8" acquired by "delete_volume" :: waited 0.023s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:36 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6159e5-8211-4ffa-8eb5-ba5f52d75170]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f845de2a-2396-4c64-8d99-6e037e48fae8 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f845de2a-2396-4c64-8d99-6e037e48fae8" returned: 0 in 0.401s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f845de2a-2396-4c64-8d99-6e037e48fae8 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:36 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-f845de2a-2396-4c64-8d99-6e037e48fae8" returned: 0 in 0.092s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:36 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-f845de2a-2396-4c64-8d99-6e037e48fae8" released by "delete_volume" :: held 0.674s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:37 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created reservations ['9f40d872-57e0-433b-8550-d6a5e184987b', 'e14f4025-3205-4f06-bc38-67287a70fb8b', 'f0059b46-f015-488e-9c57-88922c4856ce', '6bc61853-7cc7-4ba0-936d-f465daa3d79d'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:37 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:37 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.085s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:37 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:37 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Deleted volume successfully. Sep 17 18:50:37 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-f2214b3c-d4d6-4d2a-82e6-0d2d3cbadcdb tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-f845de2a-2396-4c64-8d99-6e037e48fae8-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-a0789ff9-ef93-4508-891f-05651669d5ff-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-a0789ff9-ef93-4508-891f-05651669d5ff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:38 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-quobyte-a0789ff9-ef93-4508-891f-05651669d5ff" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-a0789ff9-ef93-4508-891f-05651669d5ff" acquired by "delete_volume" :: waited 0.012s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:38 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[380dd51d-7569-4c47-9a02-c5517d8ea763]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0789ff9-ef93-4508-891f-05651669d5ff {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0789ff9-ef93-4508-891f-05651669d5ff" returned: 0 in 0.390s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0789ff9-ef93-4508-891f-05651669d5ff {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:38 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-a0789ff9-ef93-4508-891f-05651669d5ff" returned: 0 in 0.103s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:38 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-a0789ff9-ef93-4508-891f-05651669d5ff" released by "delete_volume" :: held 0.636s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:39 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created reservations ['29bc8988-50d5-4b1b-ac3a-a203a55fbd6c', 'e7fda001-47f6-4120-923e-c83114c15161', '02f8c2fc-c120-4505-8944-fc8ff62f3bd2', 'de3ddd07-ac69-40ee-9671-b3e28b23c578'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:39 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:39 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:39 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.083s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:39 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:39 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Deleted volume successfully. Sep 17 18:50:39 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-528a106f-4023-4e08-a12a-ecd942525647 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-a0789ff9-ef93-4508-891f-05651669d5ff-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-0eaaef65-a8f6-4aae-b905-963c406a92ee-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-0eaaef65-a8f6-4aae-b905-963c406a92ee-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:40 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-quobyte-0eaaef65-a8f6-4aae-b905-963c406a92ee" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:40 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-0eaaef65-a8f6-4aae-b905-963c406a92ee" acquired by "delete_volume" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:40 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[172c82a3-9a3b-4987-b379-028b43e574e1]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:40 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0eaaef65-a8f6-4aae-b905-963c406a92ee {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0eaaef65-a8f6-4aae-b905-963c406a92ee" returned: 0 in 0.387s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0eaaef65-a8f6-4aae-b905-963c406a92ee {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-0eaaef65-a8f6-4aae-b905-963c406a92ee" returned: 0 in 0.115s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-0eaaef65-a8f6-4aae-b905-963c406a92ee" released by "delete_volume" :: held 0.652s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created reservations ['97a7fe62-8f28-4757-a22a-6673f279fd38', '9a5349b1-399d-462b-a820-5bceb88132d3', '217c89bc-6886-405e-b20a-7417215b8599', '0ad1af95-6ed2-4026-861a-6855f2d2e124'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.107s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:41 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Deleted volume successfully. Sep 17 18:50:41 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-111e0cee-14ce-4c13-99fb-177058370313 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-0eaaef65-a8f6-4aae-b905-963c406a92ee-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:42 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:42 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:42 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:42 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-quobyte-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:42 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6" acquired by "delete_volume" :: waited 0.011s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:42 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4df8e6-523f-408a-8b1b-1cdb419c930f]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:42 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6" returned: 0 in 0.401s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6" returned: 0 in 0.106s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:43 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6" released by "delete_volume" :: held 0.650s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:43 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created reservations ['e7fc2817-fb8a-4218-89d5-7059d913c77e', '2b1c8233-8951-4e11-b5aa-447eab4fa41f', 'd69e6b35-6d68-4510-a724-fddd14319ffe', '506331dc-1ad5-4a94-b2f9-c8a71290edcc'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:43 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:43 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:44 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.092s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:44 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:44 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Deleted volume successfully. Sep 17 18:50:44 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-c4435fe0-32c1-482a-87f7-5df83243392f tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-c6a4c7c5-b89e-4d06-958b-dfc0a8f857a6-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:44 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-2ee1f3b7-252d-4305-9e9b-dff0c623b46a-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-2ee1f3b7-252d-4305-9e9b-dff0c623b46a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:45 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-quobyte-2ee1f3b7-252d-4305-9e9b-dff0c623b46a" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-2ee1f3b7-252d-4305-9e9b-dff0c623b46a" acquired by "delete_volume" :: waited 0.012s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:45 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfc48b6-dff9-4155-9d11-819f2ddb204c]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a" returned: 0 in 0.401s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:45 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-2ee1f3b7-252d-4305-9e9b-dff0c623b46a" returned: 0 in 0.091s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:45 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-2ee1f3b7-252d-4305-9e9b-dff0c623b46a" released by "delete_volume" :: held 0.645s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:46 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created reservations ['81a765ef-90d0-4ff5-90ce-5bdd2f96e1ae', 'a189e175-44ba-45dd-a3d7-987e4e1d406f', '56a39a0c-231c-4105-b46e-fbf64cca4a3e', 'bdf1b5a9-7613-43bb-83e4-9a52d2053d52'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:46 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:46 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.094s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:46 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:46 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Deleted volume successfully. Sep 17 18:50:46 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-60a50a7f-9561-4140-9f60-077dc7f249c6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-2ee1f3b7-252d-4305-9e9b-dff0c623b46a-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:47 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-3b315cb6-d168-4066-a8f6-f175634b7a41-delete_volume" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:47 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-3b315cb6-d168-4066-a8f6-f175634b7a41-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:47 devstack cinder-volume[83736]: WARNING cinder.volume.volume_utils [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 18:50:47 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "cinder-quobyte-3b315cb6-d168-4066-a8f6-f175634b7a41" by "delete_volume" {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 18:50:47 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-3b315cb6-d168-4066-a8f6-f175634b7a41" acquired by "delete_volume" :: waited 0.012s {{(pid=83736) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 18:50:47 devstack cinder-volume[83736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e84ea51-501a-48f3-add5-a15dc100e0dd]: (4, 'qcow2') {{(pid=84797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 18:50:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b315cb6-d168-4066-a8f6-f175634b7a41 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b315cb6-d168-4066-a8f6-f175634b7a41" returned: 0 in 0.396s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:47 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b315cb6-d168-4066-a8f6-f175634b7a41 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "rm -f /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1/volume-3b315cb6-d168-4066-a8f6-f175634b7a41" returned: 0 in 0.115s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-quobyte-3b315cb6-d168-4066-a8f6-f175634b7a41" released by "delete_volume" :: held 0.682s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG cinder.quota [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Created reservations ['0476f3ad-5e9c-4f6c-8010-b5e5821e182e', 'fadc75d6-bd86-45ef-8c0d-c5286b7ec2b0', '21e7679e-70f9-4619-b029-c6829cffe42f', 'eb189bbc-b92a-49af-a996-0c0a2fd70ae8'] {{(pid=83736) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.088s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 18:50:48 devstack cinder-volume[83736]: INFO cinder.volume.manager [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Deleted volume successfully. Sep 17 18:50:48 devstack cinder-volume[83736]: DEBUG cinder.coordination [None req-912b235b-7992-493c-9a64-2fe980b668b6 tempest-CreateVolumesFromSourceVolumeTest-584052849 None] Lock "cinder-3b315cb6-d168-4066-a8f6-f175634b7a41-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=83736) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 18:50:58 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=173,cinder:DELETE=15,cinder:SELECT=95,cinder:INSERT=41 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:50:58 devstack cinder-volume[83736]: DEBUG dbcounter [-] [83736] Writing DB stats cinder:UPDATE=152,cinder:DELETE=12,cinder:SELECT=109,cinder:INSERT=35 {{(pid=83736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 18:51:17 devstack cinder-volume[83736]: DEBUG oslo_service.periodic_task [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 18:51:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 18:51:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 18:51:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a': None} {{(pid=83736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 18:51:17 devstack cinder-volume[83736]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Available shares ['10.10.41.181/cinder-vol-fc14052d-b310-41c0-a6e1-1b582b2bba0a'] {{(pid=83736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 18:51:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.lockutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 18:51:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1 {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 18:51:17 devstack cinder-volume[83736]: DEBUG oslo_concurrency.processutils [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ddefd3883fac44636012a8422e5d2a1" returned: 0 in 0.190s {{(pid=83736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 18:51:17 devstack cinder-volume[83736]: DEBUG cinder.manager [None req-e5fd3549-d02c-4f6a-bf06-b4771c80ffd4 None None] Notifying Schedulers of capabilities ... {{(pid=83736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}